Search

Amazon Nova Sonic Audio Generation AI Model Released, Can Process Speech in Real-Time

Amazon Nova Sonic AI model comes with a context window of 32,000 tokens.

Advertisement
Highlights
  • The model offers up to eight minutes of speech generation per session
  • Amazon says Nova Sonic can understand the context behind the input speech
  • Currently, it only supports the English language in multiple accents
Amazon Nova Sonic Audio Generation AI Model Released, Can Process Speech in Real-Time

Amazon Nova Sonic can be accessed via the company’s Bedrock console via an API

Photo Credit: Amazon

Amazon introduced a new artificial intelligence (AI) model in its flagship Nova family of models on Tuesday. Dubbed Amazon Nova Sonic, it is a voice generation model capable of generating human-like speech. However, it is not a text-to-speech (TTS) tool; instead, it can process voice input in real time and respond to it. The Seattle-based tech giant says developers can use the model to build conversational AI chatbots and similar tools. Notably, the Amazon Nova Sonic AI model also supports functional calling and tool use, making it compatible with agentic application developments as well.

Amazon Nova Sonic Is Available As an API

In a blog post, the tech giant announced the release of the Amazon Nova Sonic. The company said traditional approaches to voice-enabled applications use a complex with multiple models such as text recognition, speech-to-text conversion, data processing, and TTS models. This often leads to an increase in latency, and failure in preserving linguistic context, the post added.

Amazon said its approach with the Nova Sonic model was to unify speech understanding and speech generation components. The AI model is said to be able to process data and generate speech in real time, giving it a conversation-like experience. This unified system also allows the model to better understand the pace and timbre of input speech to contextualise the intent of the user.

Additionally, the AI model can understand different speaking styles as well as separate masculine and feminine-sounding voices in different accents. It can also understand when a user misspeaks, mumbles, or pauses while speaking. Amazon says the model can pick up speech even in a noisy setting.

In response generation, the company claims the model can be more expressive and human-like, and can adjust its response style to match the context of the conversation. Currently, the AI model only supports the English language. Amazon said support for more languages will be added soon. The model supports a context window of 32,000 tokens for audio, with an additional window to handle longer conversations. It has a default session limit of eight minutes.

To use the Nova Sonic model, developers can head to Amazon Bedrock and find it under the model access option. It can also be accessed via a bidirectional streaming application programming interface (API) that can both process audio input and generate output.

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.

 
Show Full Article
Please wait...
Advertisement

Related Stories

Popular Mobile Brands
  1. Narivetta OTT Release Date: When and Where to Watch This Political Drama Online?
  2. Samsung Galaxy Watch 8 Series, Ultra 2 Specifications Leak Ahead of Debut
  1. Samsung Galaxy Watch 8 Series, Watch Ultra 2 Specifications Leak Ahead of Galaxy Unpacked
  2. Paramasivan Fathima Is Now Streaming on Aha Tamil: What You Need to Know
  3. Astronomers Discover 3I/ATLAS, Largest Interstellar Comet Yet Detected
  4. NASA's New Horizons Proves Deep-Space Navigation via Stellar Parallax
  5. AI Designs Ocean Gliders Inspired by Sea Creatures to Boost Underwater Research Efficiency
  6. Narivetta OTT Release Date: When and Where to Watch Tovino Thomas Starrer Political Drama Online?
  7. Kaalidhar Laapata Now Available on Zee5: What You Need to Know About Abhishek Bachchan's Starrer Movie
  8. Sri Sri Sri RajaVaru Now Streaming on Amazon Prime Video: Everything You Need to Know
  9. Hubble Observations Give Forgotten Globular Cluster Its Moment to Shine
  10. Very Massive Stars Blow Away Outer Layers in Powerful Winds Before Black Hole Collapse
Gadgets 360 is available in
Download Our Apps
App Store App Store
Available in Hindi
App Store
© Copyright Red Pixels Ventures Limited 2025. All rights reserved.
Trending Products »
Latest Tech News »