Meta Voicebox Unveiled as New Text-to-Speech Generative AI Model: All Details

Meta's Voicebox is claimed to deliver audio clips using a two-second audio sample.

Written by Nithya P Nair, Edited by Siddharth Suvarna | Updated: 20 June 2023 14:30 IST

Meta Voicebox Unveiled as New Text-to-Speech Generative AI Model: All Details

Photo Credit: Meta

Voicebox claimed to generate audio samples 20 times faster than Microsoft's VALL-E

Highlights

Meta Platforms introduced Voicebox
Voicebox is a machine-learning model that can generate speech
It supports six languages

Meta announced Voicebox, its advanced artificial intelligence (AI) tool that can generate speech from text last week. The latest tool by Facebook parent Meta is claimed to produce high-quality audio clips and edit pre-recorded audio while preserving the content and style of the audio. It is said to be multilingual and claimed to deliver speech in six languages. The machine learning model can be used for noise removal as well. Meta's Voicebox also has the ability to replace misspoken words without having to re-record an entire speech. The new generative text-to-speech model works like the new AI innovations including ChatGPT and Dall-E.

Facebook's parent company Meta unveiled Voicebox via a blog post last week. This new generative AI model can perform speech generation tasks — like editing, sampling, and stylising. It is claimed to deliver audio clips from a two-second audio sample and edit pre-recorded audio while keeping the content and style of the audio.

The text-to-speech model is promised to perform tasks like noise removal, content editing, style conversion, and diverse sample generation. It is stated to modify any part of a given sample and recreate a portion of the speech that's interrupted by noise such as car horns or barking dogs. The AI model can also be used to replace misspoken words without having to re-record an entire speech.

Meta to Allow 10-Year-Old Kids to Use Its Quest Headsets

Voicebox can synthesise speech across six languages — English, French, Spanish, German, Polish, and Portuguese. It can create a reading of the text in any of those languages, even when the sample speech and the text are in different languages.

Voicebox claimed to outperform Microsoft's VALL-E and generate audio samples 20 times faster. "Our results show that speech recognition models trained on Voicebox-generated synthetic speech perform almost as well as models trained on real speech, with 1 percent error rate degradation as opposed to 45 to 70 percent degradation with synthetic speech from previous text-to-speech models", Meta AI detailed in a research paper. Further, a few audio samples are listed to show users the working of Voicebox.

In the blog, Meta further claims that Voicebox can generate speech that is more representative of how people talk in the real world in the aforementioned six languages. The company believes that this capability could be used to generate synthetic data to help better train a speech assistant model in the near future.

Apple Vision Pro Will Not Provide Third-Party Apps Access to Its Cameras

Voicebox is currently under development and is not available to public users. Meta says it realises that this technology brings the potential for misuse and unintended harm like the current AI innovations. It is said to be working on an effective classifier that can distinguish between authentic speech and audio generated with Voicebox to mitigate these possible future risks.

Apple unveiled its first mixed reality headset, the Apple Vision Pro, at its annual developer conference, along with new Mac models and upcoming software updates. We discuss all the most important announcements made by the company at WWDC 2023 on Orbital, the Gadgets 360 podcast. Orbital is available on Spotify, Gaana, JioSaavn, Google Podcasts, Apple Podcasts, Amazon Music and wherever you get your podcasts.

Affiliate links may be automatically generated - see our ethics statement for details.

Comments

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.

Further reading: Meta, Facebook, Voicebox, Meta Voicebox, Voicebox Features, Meta AI

Nithya P Nair

Email Nithya P Nair

Nithya P Nair is a journalist with more than five years of experience in digital journalism. She specialises in business and technology beats. A foodie at heart, Nithya loves exploring new places (read cuisines) and sneaking in Malayalam movie dialogues to spice up conversations. More