Full archive

Benchmark: Latest AI News

Search reporting on AI markets, models, products, companies, policy, and culture.

Showing 1-7 of 7Results matching "Shift"

Earlier this week

2 stories

GPT-5 and Gemini-3 Recovered Up to 65% of Missed Facts by Thinking Longer

The Google Research and Technion benchmark shifts the diagnosis for some factual errors from missing training data to unreliable access—while leaving open whether the result holds beyond Wikipedia facts.

Sep 1, 2026

3 min readRead story

Benchmark Models

ChatGPT o3 Handles Simulated Liquidity Choices, but Consistency Slips in Harder Cases

The simulated wholesale-payments exercise defines a narrow starting point for delegated cash management: routine payment priorities, with human oversight for potentially anomalous patterns.

Aug 31, 2026

2 min readRead story

Last week

2 stories

Benchmark Models

NVIDIA Says AVO Took Claude Opus 5 From 30% to Perfect on ARC-AGI-3

The result shifts attention from training larger models to the software that gives them memory, tools and recovery loops. Its clearest limitation is equally important: the perfect score came on ARC-AGI-3’s public environments, while private sets remain the harder test.

Aug 24, 2026

3 min readRead story

Benchmark Infrastructure

NVIDIA Says Vera Rubin Delivers 30x More Agentic Throughput per Megawatt, Pending Review

The preliminary comparison shifts attention from fixed prompt benchmarks toward the power required to keep long, tool-using AI sessions responsive.

Aug 24, 2026

3 min readRead story

August 2026

3 stories

Benchmark Models

GLM-5.3’s Cheap Retries Put Fable 5’s Coding Premium Under Pressure

Together AI’s benchmark run suggests first-attempt parity is not enough to justify Fable 5’s price for general coding. But a Rust and serialization advantage, plus benchmark-specific cost assumptions, leave room for targeted routing.

Aug 22, 2026

2 min readRead story

Benchmark Models

Open Models Are Catching the Frontier Faster. Benchmark Scores Aren’t the Whole Contest.

SemiAnalysis sees the lag from closed-model breakthroughs to open-model benchmark parity shrinking across three AI eras. But a comparable model score still leaves a harder product question: who can turn capability into dependable agent work?

Aug 21, 2026

4 min readRead story

Benchmark Models

Zhipu Says GLM-5.3 Can Find Bugs Across an Exploitation Chain

The company reports strong vulnerability-discovery results on one benchmark and in 269 real-world projects. It also acknowledges weaker results elsewhere, leaving its wider standing—and the practical force of its access controls—unsettled.

Aug 17, 2026

4 min readRead story