SIMA 2: An agent that plays, reasons, and learns with you in virtual 3D worlds

We’re introducing SIMA 2, the next major milestone in general and helpful embodied AI agents. 👾

With Gemini integrated at its core, it moves beyond following basic instructions to think, learn, and collaborate in complex, 3D worlds.

🔵 Advanced reasoning: It can accomplish high-level goals in a wide array of games – describing its intentions, explaining what it sees, and outlining the steps it is taking.

🔵 Improved generalization: It can transfer concepts like “mining” in one game and apply it to “harvesting” in another – connecting the dots between similar tasks.

🔵 Self-improvement: Through trial-and-error and Gemini-based feedback, it can teach itself entirely new skills in unseen worlds without additional human input.

🔵 Adaptability: When tested in simulated 3D worlds created with our Genie 3 world model, it demonstrates unprecedented adaptability by navigating its surroundings, following instructions, and taking meaningful steps towards goals.

This research offers a strong path toward applications in robotics and another step towards AGI in the physical world.

Learn more at https://deepmind.google/sima
___

Subscribe to our channel https://www.youtube.com/@googledeepmind
Find us on X https://twitter.com/GoogleDeepMind
Follow us on Instagram https://instagram.com/googledeepmind
Add us on Linkedin https://www.linkedin.com/company/deepmind/