Google Open-Sources ARTEMIS for Android Automation, Claims 99%+ Benchmark Result

Google has open-sourced ARTEMIS, a tool that lets AI assistants carry out plain-English instructions on connected Android phones and emulators. It brings device testing into coding workflows, allowing an assistant to build and install an app, navigate screens, and return screenshots or diagnostic material.

ARTEMIS is published in Google’s public GitHub organization under the Apache 2.0 license. Its built-in Model Context Protocol server connects compatible development environments to a device-control service; the repository names Antigravity, Codex, Claude Code, and Windsurf among supported clients.

The tool runs Android testing workflows and everyday device tasks from natural-language instructions. It uses available interface elements where possible, then can use coordinates and visual locating for custom interfaces. ARTEMIS is available through a command-line interface, web test console, Python SDK, and integrations that collect replays, screenshots, Logcat output, and device diagnostics.

Flash is intended for routine, predictable interface work. Pro is built for cases where the agent must inspect targets before acting, track a plan, and recover from blocked actions; the repository says it can handle workflows of more than 100 steps. The differing time estimates make the tradeoff concrete: more control and evidence come with a slower device loop.

What teams can inspect in the release

• A first task installs an Artemis Accessibility Helper on the phone; UIAutomator2 is available as an alternative interface-hierarchy backend.
• The repository claims more than 99% task completion on AndroidWorld, Google Research’s benchmark of more than 100 multi-step tasks across more than 20 apps.

The AndroidWorld result is a company-reported benchmark claim, not proof that every real-world phone workflow will work as reliably. Still, the public code gives developers a way to examine whether ARTEMIS’s split between speed and verification fits their own device tests.