Meta introduces a new AI tool for Reels dubbing: automatic translation and lip sync in multiple languages

Meta has announced a new tool that uses artificial intelligence to automatically dub Reels videos and synchronise the speaker's lips with the translation.

Here's What We Know

The feature was announced at the annual Meta Connect event, where CEO Mark Zuckerberg demonstrated it during the keynote.

The technology not only translates content but also "reproduces the voice of the speaker in another language", which ensures accurate lip sync.

Initially, the new tool will be available for videos of some authors in English and Spanish in the US and Latin America. Meta did not specify the exact launch schedule, but noted that new languages will be added soon.

The company also announced new features for Meta AI, including voice chats with a selection of celebrity voices and the ability to edit photos based on text instructions on Instagram, Messenger, and WhatsApp.

Source: Meta