ElevenLabs is using the excitement surrounding OpenAI's Sora-generated videos to announce its own artificial intelligence capable of producing sound effects. Together, these two AIs can create very realistic clips.
Last week, OpenAI ushered in the beginning of a new cinematic era by introducing Sora, an artificial intelligence that can generate one-minute videos from a simple written request. However, the latter are incomplete because they are completely silent.
ElevenLabs just announced on its blog that it is currently working on a solution in the form of an AI that generates audio clips. The company is known for its text-to-speech software and a tool that translates speech into another language while preserving the voice. She used her new AI, simply called Sound Effects, to create sound effects to accompany the videos Sora generated.
A selection of clips generated by Sora by OpenAI, with sound effects generated by ElevenLabs Sound Effects. © ElevenLabs
Generate sound effects from text
The company asked the AI to generate sounds with prompts such as “waves crashing,” “metal colliding with metal,” “birds chirping,” and “car engine, racing car.” Currently, the generation only considers written queries and cannot analyze videos to automatically generate an audio track. Given the rate at which artificial intelligence is evolving, this feature will undoubtedly become available quickly, whether it is developed by ElevenLabs or a third party.
AI is still under development and therefore not yet available to the public. ElevenLabs has not specified a launch date, but it is possible To on the waiting list to be among the first to gain access.