ElevenLabs already offers AI-generated versions of human voices and music. Now, it will let people create sound effects for podcasts, movies, or games, too. The new Sound Effects tool can generate up to 22 seconds of sounds based on user prompts that can be combined with the company’s voice and music platform, and it gives users at least four downloadable audio clip options.
The company says it worked with the stock media platform Shutterstock to build a library and train its model on its audio clips. Shutterstock has licensed its content libraries to many AI companies, including OpenAI, Meta, and Google.
Sound Effects is free to use, but paid tiers can use the generated audio clips with commercial licenses, while free users “must attribute ElevenLabs by including ‘elevenlabs.io’ in the title.” ElevenLabs users have a set character count limit when writing prompts, with free users getting 10,000 characters per month. For Sound Effects, ElevenLabs says on its FAQs page that it will take 40 characters per second from the allotment if users set the audio clip duration themselves. If using the default audio duration, each prompt request will be charged 200 characters.
Libraries with sound effect clips already exist in the market for creators, filmmakers, and video game developers. But sometimes, these can be expensive or have trouble surfacing just the right type of sound. ElevenLabs says in its blog post that it designed Sound Effects “to generate rich and immersive soundscapes quickly, affordably and at scale.”
Other AI developers are also developing their own text-to-sound generators. Stability AI released Stable Audio last year, which creates audio clips of music and sound effects, and Meta’s AudioCraft models generate natural sound (think background noises like wind or traffic).
Source: ElevenLabs’ AI generator makes explosions or other sound effects with just a prompt
