ElevenLabs has created an AI service for voice cloning and video dubbing in 20 languages

Jacek Dylag/Unsplash

Startup ElevenLabs has developed an artificial intelligence-based service that can dub videos in 20 languages while preserving the voice actors' voices.

Here's What We Know

ElevenLabs is a startup that offers a voice cloning service using artificial intelligence based on audio samples uploaded to it. The new duplication feature does essentially the same thing: it analyses the speech of actors in a video and clones their voices. The AI then generates a new audio track in the selected language in the same style.

The tool supports more than 20 languages, including Hindi, Portuguese, Spanish, Japanese, Ukrainian, Polish and Arabic.

According to the company, the tool is designed for media companies, educators and content creators. However, they need to have permission from copyright holders to create dubbing.

ElevenLabs claims that the system will not only be able to translate content, but also generate new dialogue in the target language using the actor's own voice. The system is also capable of storing emotions and intonations.

Source: ElevenLabs