• Home
  • Ai
  • Ai News
  • Google DeepMind Introduces SIMA 2, a Gemini Powered AI Agent That Can Play Video Games

Google DeepMind Introduces SIMA 2, a Gemini-Powered AI Agent That Can Play Video Games

Google DeepMind’s SIMA 2 AI agent is the successor of SIMA, which was released in March 2024.

Google DeepMind Introduces SIMA 2, a Gemini-Powered AI Agent That Can Play Video Games

Photo Credit: Google

SIMA 2 can also interact with the user and explain what it intends to do

Click Here to Add Gadgets360 As A Trusted Source As A Preferred Source On Google
Highlights
  • SIMA stands for Scalable Instructable Multiworld Agent
  • Google says SIMA 2 can reason to think about its goals
  • The AI agent can also improve itself over time
Advertisement

Google DeepMind introduced Scalable Instructable Multiworld Agent (SIMA) 2, an artificial intelligence (AI) agent, on Thursday. It is the successor of SIMA, which was unveiled in March 2024, and comes with several improvements over it. SIMA 2 is powered by Gemini models and can now think about its actions, reason over it, and even interact with the user via a text interface. The core functionality remains the same: it is designed to play 3D open-world video games, but it now does so more effectively. The company says SIMA 2 also improves over time, learning from its experiences.

SIMA 2 Can Now Reason, Interact, and Play Games Better

In a blog post, Google DeepMind introduced and detailed the SIMA 2 AI agent. Powered by Gemini, it is not only able to execute tasks given by humans but also understand what is being asked, reason about the environment, and plan its next steps accordingly.

The system ingests visual input (the game screen or virtual world imagery) and a human-issued goal (for example: “build a shelter” or “find the red house”), then the agent interprets that goal, constructs intermediate actions and performs them via keyboard/mouse style outputs.

One of the biggest improvements in SIMA 2 is its ability to familiarise itself with new games and environments it has not been trained on. The system was evaluated in previously unseen games, such as Minedojo (a research version of Minecraft) and ASKA, a Viking survival game, and achieved better success rates compared with its predecessor.

It also accepts multimodal prompts (sketches, emojis, different languages) and can transfer concepts. For instance, it may learn “mining” in one game and apply its learnings to the notion of “harvesting” in another, without having to start from zero.

Coming to the training setup for the AI agent, SIMA 2's dataset uses human-demonstration data and auto-generated annotation by Gemini. Additionally, whenever it learns a new motion or skill in novel environments, the data is collected and fed back to train subsequent generations of the agent. DeepMind says this reduces reliance on human-labelled data and allows SIMA 2 to continue improving from its own play.

SIMA 2 still has limitations: the model's memory of past interactions remains constrained, very long-horizon reasoning (many steps ahead) remains challenging, and precise low-level actions (such as robot-style joint control) are not addressed within this game-world framework.

Despite its prowess in video games, SIMA 2 is not being developed to become a gaming assistant. DeepMind believes that by training and testing the agent in unique 3D worlds, the learnings can then be applied to embedded AI, which powers robots that work in the real world. Ultimately, the goal is to create a general-purpose robot capable of handling multiple tasks and controllable via natural language instructions.

Comments

Get your daily dose of tech news, reviews, and insights, in under 80 characters on Gadgets 360 Turbo. Connect with fellow tech lovers on our Forum. Follow us on X, Facebook, WhatsApp, Threads and Google News for instant updates. Catch all the action on our YouTube channel.

Akash Dutta
Akash Dutta is a Chief Sub Editor at Gadgets 360. He is particularly interested in the social impact of technological developments and loves reading about emerging fields such as AI, metaverse, and fediverse. In his free time, he can be seen supporting his favourite football club - Chelsea, watching movies and anime, and sharing passionate opinions on food. More
Vivo S50 Series Tipped to Launch Next Month With a Snapdragon Chip

Advertisement

Follow Us

Advertisement

© Copyright Red Pixels Ventures Limited 2025. All rights reserved.
Trending Products »
Latest Tech News »