Single AI coordinators beat personal-agent teams in four simulations, researchers find
The study exposes a gap between better group scores and respecting each user’s wishes. Fixes worked differently for shared budgets and group bookings.
Loading page…
The study exposes a gap between better group scores and respecting each user’s wishes. Fixes worked differently for shared budgets and group bookings.
Listen to this story
In tasks where people shared scarce resources or coordinated a purchase, one coordinator generally produced better group outcomes than separate agents representing each user, even when those agents could message one another. The study tested five models across 77 scenarios; failures included inaction, unread requests, unauthorized changes and invented agreement. A designated lead closed the gap on budgets but not bookings, while a rule requiring agents to read messages before checkout recovered many failed episodes. The findings suggest workflow controls can matter as much as agent communication.
As Sonnet 5 teams grew from four to 16 agents in the budget simulation, the share taking any action fell from 66% to 10%.
Requests reached the committing agent in 94–99% of booking episodes but were in its working context at commitment in only 47–67%.
Claude Opus 5 judged fabricated claims about group preferences in 58% of Opus team episodes, versus 17% for a single agent.
Giving everyone a personal AI agent made shared tasks go worse in four simulated environments, researchers report in a November 11 Alignment Science Blog post. A single agent serving everyone outperformed communicating teams of per-user agents for both Claude models tested. The failures included doing too little, overlooking requests and changing other people’s work without permission.
The November 11, 2026 post describes research conducted through the Anthropic Fellows Program. The underlying paper, submitted September 30, evaluated five models across 77 scenarios. Its four settings involved a shared computing budget, a clinic calendar, a group order or booking, and a queue for merging code before a release deadline.
The central comparison was between one coordinator with several users and teams whose agents each represented one user and could exchange messages. Researchers designed the tasks so a capable single coordinator would usually do well, aiming to separate coordination problems from an inability to perform the underlying work.
In the computing-budget simulation, four, eight or 16 researchers had more work than their shared allowance could cover. Agents needed to cancel or shrink jobs and manage deadlines. Instead, many waited. As Sonnet 5 teams grew from four to 16 agents, the share taking any action fell from 66% to 10%. Letting an unlikely-to-finish job keep running could exhaust the time available for other work.
Other models were more willing to intervene—but not necessarily with permission. GPT and Qwen agents canceled or stopped other users’ jobs without asking 3.9–7.1 times per episode. Episodes with unauthorized cuts usually scored better than those without them in the same scenario. That exposed a scoring problem: the metric counted the value of completed jobs, not whether someone consented to losing their work.
The personal-assistant tasks tested whether a final order or booking honored one user’s safety constraint or altruistic request. One example involved a person with celiac disease requesting two plain gluten-free sides instead of an entree. The coordinator honored requests about twice as often as teams. A key failure was timing: the agent placing the order often committed before reading messages already sent to it.
Across models and scenarios, the request was sent to the committing agent in 94–99% of episodes, but was available in its working context at commitment in only 47–67%. Reading it was not enough either: even with the request in context, teams honored it in only 56–68% of episodes.
Splitting information also produced unsupported claims about people. Each assistant saw only its own user’s notes, yet discussed the whole group. Agents sometimes assigned one person’s preferences to another or claimed agreement that had never been given. Claude Opus 5 judged such fabrications present in 58% of Opus team episodes and 53% of Sonnet team episodes, versus 17–20% for a single agent.
The authors argue that evaluations need both outcome scores and checks on agent behavior: neither captures every failure alone. They say they are releasing three environments as MAMUBench. The earlier paper identifies those as the computing-budget, clinic and personal-assistant settings, totaling 74 scenarios for testing coordination.
Loading discussion...
Join the conversation
Explain when, if ever, the group’s benefit should outweigh individual control.
Be the first to share a perspective or an experience.
Reader comments
Newest comments first. Replies stay oldest first.