Frontline Hotspot
Frontline Hotspot

Google builds the robot brain, not the body: Gemini Robotics ER 2 thinks while it acts

Google DeepMind announced Gemini Robotics ER 2 on 2026-07-30, released in August via Gemini API and Google AI Studio. The embodied reasoning model lets robots think while acting: continuous video understanding, multi-robot collaboration, streaming reasoning, and 91.3% moment-finding accuracy (vendor self-assessment, not independent testing). Google bets on being the "brain supplier" rather than building hardware, vs Tesla Optimus and Figure AI.

Published August 11, 20267 min read
<!-- gemini-robotics-er-2-hotspot | hotspot | Google builds the robot brain, not the body: Gemini Robotics ER 2 thinks while it acts -->

On July 30, 2026, Google DeepMind announced Gemini Robotics ER 2, releasing it in August via the Gemini API and Google AI Studio for developers, with the enterprise-grade Gemini Enterprise Agent Platform in private preview. This is not a robot you can buy. It is the "brain" for robots. Boston Dynamics' backflip was stunning, but it was mechanical gymnastics scripted frame by frame by engineers, and it fell apart the moment the environment changed. ER 2 tackles a different layer: what should be done, was the last step right, what is the next move. In a word, the leap from remote-controlled puppet to an autonomous worker that thinks while it acts. This is the second path in embodied AI after Mistral Robostral's single-camera navigation, and it deserves a clear teardown.

A boundary note first: this article is assembled from Google's official blog, the DeepMind model card, Pulse2.0, and other public sources, current as of 2026-08-11. The 91.3% accuracy figure and similar success rates cited are vendor self-evaluations, not independent third-party test results. ER 2 is an experimental, early-stage capability; the official disclosure is the final authority. This is trend analysis, not internal material.

1. What ER 2 Is: Not a Robot, but Its Project Manager

Let's clear up a misconception first: Gemini Robotics ER 2 is not a physical robot. It is an Embodied Reasoning Model that helps robots "think." Think of it as the robot's project manager: it takes in camera frames, microphone audio, and sensor data, judges what to do now, whether the last step was correct, and how to approach the next one, then outputs decision instructions for the robot's body (a VLA action model or robotic arm) to execute.

Per the official model card, ER 2 is built on Gemini 3.5 Flash, supporting interleaved text, image, video, and audio input, with a 128K-token context window and up to 64K tokens of output. This means it can understand a live video stream the way you follow a TV series, rather than looking at one static frame per decision like a goldfish with intermittent amnesia. It remembers what happened minutes ago and adjusts its current action accordingly.

One distinction to stress: ER 2 is a reasoning model. It outputs decision instructions ("put the red block in the blue box"), not motor control signals. Turning an instruction into joint rotation still requires the action model layer (VLA 2), and VLA 2 remains limited. Do not treat ER 2 as a turnkey system that can drive a robot end to end.

2. Three Core Upgrades: Continuous Video, Multi-Robot Collaboration, Streaming Reasoning

CapabilityER 1.6 (previous)ER 2 (current)Practical meaning
Video understandingStatic images + short clipsContinuous video stream, real-timeRobot watches itself work, self-corrects live
Task orchestrationSingle-task executionMulti-step complex task planningHandles compound commands like "brew coffee, then bring it to me"
CollaborationSolo operationMulti-robot coordinationMultiple robots share space, divide work
Progress trackingNone91.3% moment-finding accuracyKnows precisely which step it is on
Self-correctionLimitedReal-time anomaly detection and adjustmentPicks up a dropped object and carries on
Tool useNot supportedGoogle Search and custom function callingLooks things up on the fly when stumped

First, real-time continuous video understanding is the biggest single-point breakthrough here. Earlier robot vision models read static frames; ER 2 reads a continuous stream, tracks its own progress, self-corrects on errors, and pinpoints when to advance to the next step. Second, multi-step task orchestration plus multi-robot collaboration makes ER 2 a natural fit for factories and warehouses, the multi-device scenarios. Third, the 91.3% moment-finding accuracy comes with a caveat: this is a vendor self-evaluation, not an independent third-party test. The long-tail distribution of real-world scenes will pull the actual number down, so do not treat it as a production-line guarantee.

One more upgrade that is easy to overlook but matters: Streaming Reasoning. Traditional robots plan, then execute, then plan again, with dead time in between. ER 2 predicts the next step while executing the current one, thinking while moving without stopping. That is a qualitative lift for industrial fluency. Layer on Google Search and custom function calling, and a robot can look up an unfamiliar object mid-task and keep going.

Take a concrete scene: two robots in a warehouse, one sorting, one palletizing. Older setups either run them blind to each other or lean on a central scheduler to hard-orchestrate every move. ER 2 lets the two share a single reasoning context and coordinate among themselves who goes first, who yields at the aisle, effectively putting a project manager inside each machine. For multi-device production lines, that means a lighter central scheduler and heavier edge autonomy, cutting the cascading impact of any single-point failure.

3. Google's Bet: No Hardware, Just the Brain Supplier

Google's move is clear: it is not building robot bodies. Tesla is grinding on Optimus hardware mass production, Figure AI is vertically integrated with OpenAI, and Google took a third path, turning ER 2 into an open platform anyone can use.

DimensionGoogle ER 2Tesla OptimusFigure AI
Core strengthFoundation model + open ecosystemHardware mass production + in-house factoryVertical integration + scene focus
Business modelSells the brain (API/platform)Sells the body (humanoid robot)Sells whole solutions
OpennessAPI + AI Studio openClosed, in-house onlySemi-open, enterprise deals
Key weaknessNo hardware, depends on third-party bodiesModel capability relatively narrowEcosystem not open enough

The ambition here is an "Android moment for robotics": Android never made phones yet came to dominate the mobile operating system, and Google wants to be the unified brain for all robots. If it works, the moat is far deeper than selling hardware. Hardware iterates and gets cheaper, but a reasoning model embedded in a robot body is extremely costly to swap out.

4. Safety Plays and Sober Second Thoughts

A robot brain, no matter how smart, is a ticking bomb if safety does not hold up. Google shipped the ASIMOV-Agentic safety benchmark alongside ER 2, specifically testing robot decision-making under uncertainty: whether it rejects unsafe tool calls, whether it can foresee task feasibility, and whether it proactively asks a human to step in when unsure. ER 2 also improved on human-approach detection, sensing people nearby and triggering a safe stop, a credential for collaborative safety on the factory floor.

Three buckets of cold water. First, ER 2 is the reasoning layer; the action model VLA 2 is still limited. "Thinking right" does not equal "acting steady," and the last mile of hand-eye coordination is not yet closed. Second, the official success rates are vendor self-evaluations. A benchmark, however hard, is still a controllable setup, and the long tail of real-world scenes is endless, so lab numbers always discount on the production line. Third, these are experimental, early-stage capabilities. Home scenarios are far from landing; cost, safety, and reliability are three mountains still uncrossed. Realistic near-term deployment concentrates on the B2B side: industrial machine tending and assembly, logistics sorting and palletizing, lab sample handling, scenes with relatively high fault tolerance and strong generalization needs that are exactly ER 2's sweet spot. Industrial scenes have mature fault-tolerance mechanisms: a failed attempt can be retried, and physical guards like fences and emergency stops backstop the system. A home scenario is a different beast entirely, where one misstep can injure someone, and the safety redundancy needed is not in the same league. So do not get swept up by model capability and start dreaming of a home butler; B2B is where this generation of reasoning models earn their keep.

5. Practical Impact for Developers

Developers can now call ER 2 through the Gemini API and Google AI Studio, with enterprise features via the Gemini Enterprise Agent Platform private preview. Three things to remember when getting started: ER 2 outputs decision instructions, so you must write your own translation layer to map text instructions to robot actions; production deployment requires safety constraints (human-approach detection, emergency-stop logic), so do not ship it raw; and do not equate ER 2's reasoning ability with a complete robotics stack, since the action layer, perception layer, and safety layer each have their own independent barriers.

For anyone doing tech selection, Google's "brain supplier" route means you can focus on the body and the scene while outsourcing reasoning to ER 2. But weigh the risk of handing your lifeline to someone else: API pricing, model iteration cadence, and availability all depend on Google. Set against Mistral Robostral, the contrast is telling: Mistral in mid-July took the route of compressing perception cost with a single camera, while Google takes the brain route of multi-robot collaboration plus streaming reasoning. Two paths, one problem: stop treating robots like puppets.

If you are already on the Gemini stack (Gemini API, Vertex AI), the migration cost to ER 2 is the lowest: the model card and official examples are ready to go. If you are on a different large-model stack, the question to evaluate is whether ER 2's multimodal video understanding is far enough ahead to justify crossing stacks. Do not migrate a whole toolbox for one capability. Also watch Google's pricing closely: reasoning models bill by token, and continuous video stream input burns far more tokens than text, so run the numbers on a long-running production line before committing.

6. FAQ

Q: Is ER 2 a robot? Can I buy one? A: No. ER 2 is an embodied reasoning model, not a physical robot. It handles the "thinking"; execution falls to the VLA action model and the robotic arm. It is currently available via the Gemini API and Google AI Studio, with enterprise features in the Gemini Enterprise Agent Platform private preview.

Q: Is the 91.3% accuracy reliable? A: Take it with a discount. It is a vendor self-evaluation, not an independent third-party test. A benchmark is a controllable setup, and real-world long-tail scenes will drag the actual number down. Do not treat it as a production-line promise.

Q: What is the relationship between ER 2 and VLA 2? A: ER 2 is the reasoning model, outputting decision instructions (what to do); VLA 2 is the action model, turning instructions into motor control signals (how to move). ER 2 is open for calls, while VLA 2 remains limited. "Thinking right" does not equal "acting steady."

Q: What is streaming reasoning and why does it matter? A: Traditional robots plan, then execute, then plan again, with lots of pauses. Streaming reasoning lets the model predict the next step while executing the current one, thinking while moving and cutting dead time. For industrial fluency, that is a qualitative leap.

Q: How does Google differ from Tesla Optimus and Figure AI? A: Google does not build hardware. It plays the "brain supplier," opening ER 2 to all developers via API; Tesla pursues hardware mass production, and Figure AI does vertical integration. Google is betting on an "Android moment for robotics": not building the phone, but dominating the operating system.


References

This article is AI-assisted and human-edited. Last updated: 2026-08-11

FAQ

Is ER 2 a robot? Can I buy one?
No. ER 2 is an embodied reasoning model, not a physical robot. It handles the "thinking"; execution falls to the VLA action model and the robotic arm. It is currently available via the Gemini API and Google AI Studio, with enterprise features in the Gemini Enterprise Agent Platform private preview.
Is the 91.3% accuracy reliable?
Take it with a discount. It is a vendor self-evaluation, not an independent third-party test. A benchmark is a controllable setup, and real-world long-tail scenes will drag the actual number down. Do not treat it as a production-line promise.
What is the relationship between ER 2 and VLA 2?
ER 2 is the reasoning model, outputting decision instructions (what to do); VLA 2 is the action model, turning instructions into motor control signals (how to move). ER 2 is open for calls, while VLA 2 remains limited. "Thinking right" does not equal "acting steady."
What is streaming reasoning and why does it matter?
Traditional robots plan, then execute, then plan again, with lots of pauses. Streaming reasoning lets the model predict the next step while executing the current one, thinking while moving and cutting dead time. For industrial fluency, that is a qualitative leap.
How does Google differ from Tesla Optimus and Figure AI?
Google does not build hardware. It plays the "brain supplier," opening ER 2 to all developers via API; Tesla pursues hardware mass production, and Figure AI does vertical integration. Google is betting on an "Android moment for robotics": not building the phone, but dominating the operating system.

Related

Frontline Hotspot

GPT-6 Astra Lands on Google Cloud, but Microsoft Keeps the Crown

On October 21, 2026, OpenAI announced a partnership with Google Cloud: frontier models plus the Codex agent workflow are coming to Google Cloud Model Garden, enterprise purchases can draw down GCP spend commitments, and general availability is planned in the coming weeks. Google Cloud's blog names three models - GPT-6 Astra, GPT-6.1 Sol, and GPT-6 Luna, all in private preview - and calls Google Cloud the only hyperscale cloud provider offering access to all three leading closed source LLMs. Astra pricing is public on the API side: 10 dollars per million input tokens, 50 dollars output, a 1.05M context window, 128K max output, valid through April 30, 2026; Google-channel pricing is unpublished. Sol is the low-cost tier from DevDay on September 29 (2/10 dollars, about a fifth of Astra, officially pitched as near-Astra performance for complex work). Microsoft relations carry an explicit official caveat: the OpenAI post closes with Microsoft remains OpenAI's primary cloud partner, so this is not a defection. Media caliber (Reuters/CNBC): Microsoft's exclusive distribution expired in April, AWS followed a day later, Google completes the trifecta; Anthropic drew 47 percent of its 2025 revenue from AWS and Google per IPO filings; Google Cloud grows about 82 percent, fastest of the three. Naming lineage: the internal Astra that solved ten decade-old math problems in August with Lean-verifiable proofs is widely linked by media but never officially equated to GPT-6 Astra. Unpublished: parameter count, Google-channel pricing, exact GA date, open weights (API and enterprise hosting only).

Oct 24, 20268 min read
Frontline Hotspot

iFlytek Spark X2.6: A 293B Flagship, but Only a 4B Is Open

iFlytek launched Spark X2.6 at its global 1024 Developer Festival in Beijing on October 22, 2026: a 293B-parameter MoE that activates 30B per token, a 1M-token context window, an end-cloud integrated design, trained entirely on domestic compute and served from a 10,000-card domestic inference cluster. The efficiency ledger, all vendor-reported: training 2000B tokens of 256K-length data on the Feixing-2 platform fell from 4.5 months to 1.2 months (a 4x gain), and the first fully domestic four-layer KV Cache architecture lifted hit rate from 63 to 95.7 percent with 4.5x inference efficiency. Self-reported scores put SWE Pro at 77.3 and SWE Multilingual at 95.0, both first, with SWE Verified at 95.4 behind only DeepSeek-V4.1-Flash 1017's 95.6 - yet there is no complete score table, no technical report, and no third-party replication. The key correction: the viral headline 'iFlytek open-sources X2.6' misreads the release. Only the on-device Spark-X2.6-4B is open under Apache 2.0 (Hugging Face under the XHToken namespace, ModelScope mirror, Ollama as SparkLLM), while the 293B flagship stays API-only. The 4B self-reports six gains including BFCL-V4 71.8 and SWE Verified 62.8. Launch pricing is 0.9 / 0.08 / 3.6 yuan per million tokens. The narrative layer predicts 60 percent local, 30 percent hybrid, 10 percent cloud workloads with routing accuracy up from 81.2 to 96.1 percent; the chairperson's 'only model trained on fully domestic compute' is a unilateral claim with no chip model disclosed. Unpublished: chip models, cluster size, total FLOPs, technical report, flagship weights.

Oct 23, 20268 min read
Frontline Hotspot

Xing4.0-29B-Intent Scores 58: Why Gemini Leads the Category

The Xingchen General Intelligence Lab of China Telecom Artificial Intelligence Technology released and open-sourced Xing4.0-29B-Intent on October 19, 2026: a 29B MoE model that activates roughly 4B parameters per token and turns a sentence of natural language into a category plus args JSON structure that downstream systems can read directly, shipping 2.75 million training samples, the weights, and an inference image. The official evaluation totals 58 (intent understanding 81, event extraction 40, relation extraction 38, named entity recognition 72, category score 69), against Gemini-3.6-Flash at 49, Qwen3.8-Max 46, Kimi-K3 45, and GPT-5.6-Sol 45. Two caveats matter. First, the category column is led by Gemini-3.6-Flash at 71 - the lead comes from event extraction, relation extraction, and intent understanding, while named entity recognition is ahead by a single point. Second, the official WeChat evaluation table lists 18 rows while the GitHub README keeps only 11, so the two official tables differ in length, and those 18 rows include the model under test, leaving 17 general-purpose rivals. The WeChat post also carries a second 5,606-question table (70 / 56 / 53 / 65) that never reached GitHub. The evaluation is self-run, and the announcement itself states the results do not represent all tasks or real deployment scenarios. Data side: 2,753,000 samples rebuilt from 61 public datasets plus China Telecom's own assistant data, spanning 19 domains and 52 languages, with a label set of 170+ intents and 148 slots - while the shipped schemas measure 347 categories and 147 unique slots in union, an unexplained gap. Licensing: weights, public data, and the Python SDK are all under Apache-2.0, yet the repository LICENSE is an unfilled placeholder template, the weight side has no standalone LICENSE file, and the dataset carries upstream terms that users must check themselves. Latency, minimum VRAM, API pricing, and training details are not published; the widely quoted sub-150-millisecond response is a media figure, not an official one.

Oct 22, 20269 min read