Search

Nvidia Releases Cosmos-Transfer1 AI Model That Can Be Used for Simulation-Based Training for Robots

Nvidia’s Cosmos-Transfer1 is a diffusion-based conditional world model for multimodal controllable world generation.

Advertisement
Highlights
  • The Cosmos-Transfer1 features seven billion parameters
  • It is available with the permissive Nvidia Open Model License
  • Cosmos-Transfer1 offers granular control over scene generation
Nvidia Releases Cosmos-Transfer1 AI Model That Can Be Used for Simulation-Based Training for Robots

It can be used to create training environments for physical AI such as robots and autonomous vehicles

Photo Credit: Nvidia

Nvidia released a new artificial intelligence (AI) model last week that can be used to train robots on simulation. Dubbed Cosmos-Transfer 1, the new world generation large language model (LLM) is aimed at AI-powered robotics hardware, also known as physical AI. The company has released the model in open source with a permissive licence, and interested individuals can download it from popular online repositories. The Santa Clara-based tech giant highlighted that the main advantage of the latest AI model is that users will have granular control over the generated simulations.

Nvidia Releases AI Model to Train Robots

Simulation-based robotics training has gained wind in recent times due to the advancement in generative AI technology. This specific branch of robotics deals with hardware that uses an AI for its brain. Essentially, the training method trains the brain of the machine in various real-world scenarios so that it can handle a wider range of tasks. This is a big improvement compared to current robots in factories that are designed to complete a single task.

Nvidia's Cosmos-Transfer1 is part of the company's Cosmos Transfer world foundation models (WFMs) which ingest structured video input such as segmentation maps, depth maps, lidar scans and more to generate photoreal video outputs. These outputs can then be used as simulation ground to train physical AI.

In a paper published in the arXiv journal, the company stated that this model offers greater customisation than its predecessors. It enables varying the weight of different conditional inputs based on spatial location. Essentially, this will allow developers to generate highly controllable world generation. Another advantage of the model includes real-time world generation that is helpful in faster and more diverse training sessions.

Coming to model specifics, the Cosmos-Transfer1 is a diffusion-based model with seven billion parameters. It is designed for video denoising in the latent space, and can be modulated by a control branch. The model accepts text and video as input, and using both, it can generate a photorealistic output video. The model supports four types of control input videos including canny edge, blurred RGB, segmentation mask, and depth map.

The AI model has been tested on Nvidia's Blackwell and Hopper series chipsets, and the inference was run on the Linux operating system. The tech giant has made the AI model available with the Nvidia Open Model License Agreement which allows both academic and commercial usage.

Nvidia's Cosmos-Transfer1 AI model can be downloaded from the company's GitHub listing and Hugging Face listing. Another AI model with 14 billion parameters is expected to be released soon.

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.

 
Show Full Article
Please wait...
Advertisement

Related Stories

Popular Mobile Brands
  1. Vivo X200 FE Global Launch Confirmed; Design Teased
  2. Vivo Y400 Pro 5G India Launch Date Confirmed; Design Revealed
  3. Poco F7 Launch Date, Price in India, Design and Key Features Leaked Online
  4. Tecno Pova 7 5G Series Confirmed to Launch in India Soon
  5. OnePlus Nord 5 Series, OnePlus Buds 4 to Launch in India on This Date
  6. Oppo Reno 14 5G Series, Watch X2 Mini, Enco Buds 3, Pad SE to Launch Globally
  7. Hisense U7Q Mini-LED TV Launched in India With These Features
  8. Switch 2 Had the Biggest-Ever Launch Week for Video Game Hardware in the US
  9. Oppo K13 Turbo Pro Key Specifications Leaked Online
  10. Oppo K13x 5G India Launch Date, Price Range and Key Features Revealed
  1. Bitget Partners UNICEF Unit to Expand Blockchain Training Across India, Other Countries 
  2. WhatsApp Reportedly Working on Ability to Scan Documents on Android Smartphones
  3. ElevenLabs Expands Eleven V3 Text-to-Speech Model With Support for 41 New Languages
  4. Vivo T4 Lite 5G India Launch Confirmed; Battery Capacity, Price Range Teased
  5. TikTok Pushes Deeper Into AI-Generated Video Ads With New Tools
  6. Apple Risks Fresh EU Charge Sheet Over App Store Curbs
  7. The Witcher 4 Will Target 60 FPS on Consoles, but Series S Will Be 'Extremely Challenging' Says CD Projekt Red
  8. Oppo Reno 14 5G Series Global Launch Teased Alongside Watch X2 Mini, Enco Buds 3 and Pad SE
  9. Microsoft Begins Testing AI Agents in Windows 11, Brings Option to Share Recall Snapshots in Europe
  10. watchOS 26 to Bring Control Center Customisation Options with User-Defined Toggles
Gadgets 360 is available in
Download Our Apps
App Store App Store
Available in Hindi
App Store
© Copyright Red Pixels Ventures Limited 2025. All rights reserved.
Trending Products »
Latest Tech News »