Stable Audio Open Released by Stability AI as an Open-Source Text-to-Audio Generator

Stability AI’s Stable Audio Open can generate up to 47 seconds of samples and sound effects.

Advertisement
Written by Akash Dutta, Edited by David Delima | Updated: 6 June 2024 13:55 IST
Highlights
  • Stability AI’s new model can generate instrument riffs and ambient sounds
  • Users can generate different variations and styles of the sound sample
  • Stability AI said users can fine-tune the model on custom audio data
Stable Audio Open Released by Stability AI as an Open-Source Text-to-Audio Generator

Stability also has a Stable Audio AI platform that can generate up to three-minute-tracks

Photo Credit: Stability AI

Stability AI has released an open-source artificial intelligence (AI) model dubbed Stable Audio Open. Users can leverage the model to generate up to 47 seconds of samples and sound effects. Users can use it to create samples of musical instruments or ambient sounds. The AI model also allows users to generate different variations and styles of a previously generated sample. The open-source model is separate from the AI firm's Stable Audio platform which allows users to generate up to three-minute-long tracks and is only available as part of a subscription.

Stability AI Releases Stable Audio Open

Stable Audio Open works similarly to many available AI models in the market. Users can write a text prompt for a sample or sound effect and it will generate up to 47 seconds of audio. Stability AI mentioned in a newsroom post that the AI model was released in open source to empower sound designers, musicians, and creative communities.

However, it has limited the use of Stable Audio Open to research and non-commercial usage. To get commercial rights, users will have to purchase a Stability AI membership.

In terms of features, it can generate drum beats, instrument riffs, ambient sounds, foley recordings and other audio samples. Further, users can also fine-tune the model using their custom audio data.

Advertisement

Highlighting an example, the AI firm says a drummer can train the AI on recordings of their drumming sessions and use the model to generate new beats. While the model can generate short audio samples, it is not optimised for full songs, melodies, or vocals.

To train Stable Audio Open, the company used a dataset of 4,86,492 audio recordings sourced from FreeSound and Free Music Archive. It added, “We conducted an in-depth analysis to ensure no unauthorised copyrighted music was present in our training data before we began training.”

Advertisement

However, Stability AI also said that the dataset lacks diversity and all cultures were not equally represented. As a result, the generated samples will reflect biases from the training data. To access the AI model, users can go to the company's Hugging Face listing, where the open model weights are currently hosted.

 

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.

Advertisement
Popular Mobile Brands
  1. Android 16 Update Is Coming Soon - Here's What to Expect
  2. Motorola Edge 60 With 5,500mAh Battery Launched in India: Price, Offers
  3. Realme Announces Limited-Time Discounts on Realme GT 7 Series in India
  4. Apple Announces iOS 26 With Liquid Glass Design, These New Features
  5. Nothing Phone 3 Leaked Render Suggests Design, Triple Rear Camera Unit
  6. Know All About Apple's New Liquid Glass Design Language
  7. Asus TUF Gaming F16, Gaming A16, ROG Strix G16, Zephyrus G14 Debut in India
  8. iOS 26, iPadOS 26 Are Compatible With These iPhone and iPad Models
  9. Activision Says It's Working With Nintendo to Bring Call of Duty to Switch
  10. Samsung Galaxy S25 Ultra Allegedly Saves Life by Stopping Shrapnel
  1. What is Liquid Glass Interface, Apple’s New Universal Design Language for iPhone, iPad, Mac, and Other Devices
  2. Activision Says It's Working With Nintendo to Bring Call of Duty to Switch After Black Ops 7 Reveal
  3. Asus TUF Gaming F16, TUF Gaming A16, ROG Strix G16 and ROG Zephyrus G14 2025 Variants Launched in India
  4. UK Bolsters Web3 Investigations, Appoints First Crypto Intelligence Specialist to Insolvency Service
  5. Latest Windows 11 Insider Preview Lets You Try a New Start Menu With Scrollable Interface, More Features
  6. Vodafone Idea (Vi) Announces Rollout of 5G Services in Bengaluru
  7. Android 16 Update Release Date, Eligible Devices and What to Expect
  8. Realme GT 7, Realme GT 7T Get Up to Rs. 6,000 Discount for a Limited Time in India
  9. Nothing Phone 3 Leaked Render Suggests Transparent Back Panel, Triple Rear Cameras, No Glyph Interface
  10. ChatGPT Down: Thousands of Users Report Problems While Generating Responses, Video Generation on Sora
Gadgets 360 is available in
Download Our Apps
Available in Hindi
© Copyright Red Pixels Ventures Limited 2025. All rights reserved.