Meta AI Translations are initially available for English-to-Spanish and Spanish-to-English.
Meta AI Translations feature is accessible to Facebook creators with at least 1,000 followers
Photo Credit: Meta
Meta is now expanding its AI-powered voice translation feature to Facebook and Instagram users worldwide. This tool enables creators to reach a wider audience by automatically translating spoken content into different languages. Initially, the translations are available in select languages only. Using generative AI, the feature can translate voice and optionally sync the lip movements to match. Translated Reels will appear in viewers' preferred language, along with a note indicating that Meta AI handled the translation.
Through a blog post on Tuesday, Meta announced that it is expanding Meta AI Translations that, once enabled, can automatically dub and lip sync reels into another language. This tool allows users to speak to viewers in their own languages and helps creators to reach and better connect with audiences all over the world.
Meta says the AI Translations mimics the sound and tone of your own voice, making the translated audio feel natural and true to you. The lip-syncing feature aligns your mouth movements with the translated speech, creating the effect that you're speaking the language. Users can enable or disable the feature, and review or remove translations whenever they like.
The new Meta AI Translations are initially available for English-to-Spanish and Spanish-to-English. The social media giant has plans to support more languages soon. The feature is accessible to Facebook creators with at least 1,000 followers and all public Instagram accounts.
Translated reels are shown to users in their preferred language, with a note indicating they were translated by Meta AI. Viewers can opt out of translations for specific languages by selecting Don't translate in the audio and language section within the three-dot settings menu.
Photo Credit: Meta
After publishing translated content, you'll get a new view breakdown by language. This lets you quickly see which languages your audience is watching in, helping you gauge the performance of your translations.
Meta recommends using the AI Translations feature mainly for face-to-camera videos for the best results. Users should face forward, speak clearly, and keep their mouths visible. On Facebook, translations support up to two speakers, and it is best to avoid overlapping speech. Also, keeping background noise and music minimal helps ensure more accurate translations.
Additionally, Meta confirmed that creators with a Facebook Page can now upload up to 20 dubbed audio tracks to a single Reel to reach a wider audience. Viewers will hear your reel in their preferred language. Users can head to the Reels composer in Meta Business Suite, check Upload your own translated audio tracks under Closed captions & translations, then upload and tag each track with the corresponding language.
You can edit these tracks before or after publishing. Once live, the reel will play in the viewer's chosen language, just like with Meta AI translations.
Get your daily dose of tech news, reviews, and insights, in under 80 characters on Gadgets 360 Turbo. Connect with fellow tech lovers on our Forum. Follow us on X, Facebook, WhatsApp, Threads and Google News for instant updates. Catch all the action on our YouTube channel.