Google DeepMind adds sound and interactive dialogue to Genie 4’s simulated worlds
DeepMind promises better physics and more natural people, but worlds stay consistent for only a couple of minutes. Wider access has no firm date.
Loading page…
DeepMind promises better physics and more natural people, but worlds stay consistent for only a couple of minutes. Wider access has no firm date.
Listen to this story
The update’s practical test will be whether generated environments stay coherent long enough for useful work: DeepMind says Genie 4 loses its initial context after only a couple of minutes, despite Gemini 3.8 Flash steering frames and live edits. It adds native ambient audio and dialogue that changes with the simulation, alongside company-reported gains in physics and human movement. Access is planned through the Gemini API and AI Studio, and through Project Genie for AI Ultra subscribers; launch timing and developer pricing remain unannounced.
A small group of trusted testers is using Genie 4; DeepMind plans wider access soon but has not given a release date.
Project Genie consumer access is planned in phases for AI Ultra subscribers, whose plans start at $100 per month; access for AI Pro and AI Plus is only a possibility.
Gemini 3.8 Flash breaks down goals and evaluates frames, helping users change weather, add elements, or move the camera while a simulation runs.
Google DeepMind has introduced Genie 4, bringing sound to its AI-generated worlds and promising characters whose dialogue changes with the simulation. The update also targets more convincing physics and human movement. Google plans wider developer and consumer access, moving beyond a small testing group, but has not set a release date.
Genie 4 follows Genie 3, which remained confined to the limited Project Genie web experience. DeepMind presents these systems as more than a way to make something that looks like a video game: it sees world models as a route toward artificial general intelligence and a tool for creating environments in which robots could train.
A world model generates an environment frame by frame as someone explores it. Instead of requiring a pre-rendered setting and separately programmed interactions, it builds the experience from a prompt in real time. DeepMind also points to rapid prototyping in creative work as a potential use. Those ambitions depend on how faithfully the generated world behaves, not simply how convincing one frame looks.
To keep the experience on course, Genie 4 uses Gemini 3.8 Flash as a guiding agent. It breaks down goals and evaluates output frames, helping the simulation preserve its original context as the user moves through different environments. The guiding model is meant to keep successive images connected to the requested experience rather than letting the scene drift.
Users can also change the scene while it runs, a feature carried over from Genie 3. They can alter the weather, introduce an element or move the camera, with Gemini helping steer each update. The interaction is therefore not limited to choosing an opening prompt and watching a fixed sequence play out.
DeepMind says the new version handles aerodynamics and collisions more realistically. It also says simulated people move more naturally and respond better to changes around them. These are company-described improvements, rather than an independent assessment of how accurately Genie 4 reproduces physical behavior.
Audio adds another layer. Genie 4 is DeepMind’s first world model with native sound generation, including ambient background noise and audio elements specified in a prompt. Beyond those sounds, DeepMind promises interactive human speech: dialogue that adapts when the simulation changes, rather than remaining a fixed accompaniment to the images.
A small group of trusted testers has been working with Genie 4 as DeepMind prepares a wider release. The company still describes world models as an active research area. Access is supposed to broaden soon, but interested users currently have a waitlist rather than a specific date for when they can begin.
Google may eventually extend consumer access to AI Pro and AI Plus, but that is a possibility, not a committed rollout. Project Genie will remain the consumer interface, with limits on how much users can do. For developers evaluating the planned release, both the price and the date remain open.
Loading discussion...
Join the conversation
Explain whether short experiences would be enough for you.
Be the first to share a perspective or an experience.
Reader comments
Newest comments first. Replies stay oldest first.