Nvidia Executive Claims AI-Powered Robots in the Future Will Be Trained on Simulation, Share a Hive Mind

Nvidia’s Jim Fan said that the majority of AI robots in the future will not be trained in isolation.

Advertisement
Written by Akash Dutta, Edited by Siddharth Suvarna | Updated: 26 December 2024 18:59 IST
Highlights
  • AI-powered robots are also known as embodied AI
  • Jim Fan said most embodied AI agents will be born in simulation in future
  • These robots will also connect with other robots to complete tasks
Nvidia Executive Claims AI-Powered Robots in the Future Will Be Trained on Simulation, Share a Hive Mind

Jim Fan highlighted the example of the City of Tokyo releasing a 3D digital twin of the city on cloud

Photo Credit: Reuters

Nvidia's Senior Research Manager and Lead of the Embodied AI division Generalist Embodied Agent Research (GEAR) Lab, Jim Fan, highlighted how artificial intelligence (AI) robots in the future could be trained and function. The executive claimed that soon embodied AI agents will be born in simulation where they will learn and gain expertise in specific tasks. He also highlighted that soon entire cities, houses, and factories will be transported to simulations, making training AI on real-world scenarios possible. He also postulated that future AI robots could share a hive mind.

Nvidia's Jim Fan Shares How AI Robots Could Be Trained in the Future

Fan shared his ideas in a post on X (formerly known as Twitter), as he highlighted that the City of Tokyo has released a 3D digital twin of the entire city in a high-resolution point cloud, and made it free to download. Sharing the development, the Nvidia executive stated that this trend of taking real-world institutions to digital simulations is only going to grow in the future.

“It's an inevitable trend that more and more cities, houses, and factories will be transported into simulations,” Fan said.

Sharing the example, Fan also added that in the future, robots will not be trained in isolation. Currently, robots are trained in controlled environments where they can learn how to move around, identify objects, pick and drop things, and complete tasks. However, many have claimed that this method of training does not prepare the robots for various challenges they might face in real-world scenarios.

Advertisement

Offering a solution to the problem, the Nvidia research manager claimed that soon embodied AI agents will be simulated as an iron fleet. Notably, embodied AI agents are AI systems integrated with a physical body or a simulated embodiment, enabling them to interact with and perceive the world like humans or animals.

Fan said that future AI robots will be deployed in real-time graphics engines and will be scaled across a huge cluster. Such training methods will also produce trillions of high-quality training tokens, he added. Taking the hypothetical vision further, he said, “The majority of embodied agents will be born in sim, and transferred zero-shot to our real world when they are ready.”

Advertisement

Once these AI robots have been deployed in the real world, such as factories or as assistants in offices and homes, they will also share a hive mind. Such hive minds can enable the embodied agents to learn from thousands of use cases as well as coordinate difficult tasks with multi-agent efforts.

While this might appear to be science fiction, Fan, who is leading the embodied AI division at Nvidia, is confident that this will be the direction to train highly efficient robots in the near future. And it appears that Nvidia is already moving in that direction. He shared that the company's Santa Clara headquarters buildings are “designed and rendered in Omniverse, a GPU-accelerated graphics platform, before materialising in atoms.”

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.

Advertisement

Related Stories

Popular Mobile Brands
  1. 5 Must-Have Samsung Products Every Student Needs in 2025
  1. Webb Telescope Uncovers Hidden Active Galactic Nuclei
  2. SpaceX Starship Flight 9 Reuses Booster, Gathers Key Data Despite Loss
  3. 7,100-Year-Old Skeleton Reveals Unknown Human Lineage in China
  4. SpaceX Aims to Break Launch Record With 170 Orbital Liftoffs Planned for 2025
  5. Scientists Capture Plasma Streams, Coronal Raindrops in Sharpest-Ever View of Sun’s Corona
  6. The Traitor OTT Release Date: When and Where to Watch Uorfi Javed, Karan Kundra Starrer Reality Show Online?
  7. Nizarkudai Now Available for Streaming on Aha Tamil: What You Need to Know
  8. Big Ben OTT Release: When and Where to Watch Malayalam Movie Online?
  9. Akkada Ammayi ikkada Abbayi Now Streaming on Amazon Prime Video
  10. Vaanil Thedinen Now Streaming on Aha Tamil: Everything You Need to Know
Gadgets 360 is available in
Download Our Apps
Available in Hindi
© Copyright Red Pixels Ventures Limited 2025. All rights reserved.