Full archive

Benchmark: Models AI News

Search reporting on AI markets, models, products, companies, policy, and culture.

Showing 1-4 of 4Results matching "Scale AI"

Earlier this week

1 story

Aug 31, 2026Models

Benchmark Models

ChatGPT o3 Handles Simulated Liquidity Choices, but Consistency Slips in Harder Cases

The simulated wholesale-payments exercise defines a narrow starting point for delegated cash management: routine payment priorities, with human oversight for potentially anomalous patterns.

2 min

Last week

1 story

Aug 24, 2026Models

Benchmark Models

GPT-BERT Beats Llama 2 70B on One Grammar Test With 100 Million Words

The narrow result does not make child-scale models competitive with frontier chatbots. It does show that massive pretraining corpora do not settle every language-learning test.

3 min

August 2026

2 stories

Aug 22, 2026Models

Benchmark Models

Stanford Won Databricks’ Agent Cup, but 18.8% of Questions Stumped Every Team

The live contest tested whether agents developed on one benchmark could handle an unfamiliar Treasury archive. Stanford led the field, but the unsolved questions show the limits of reliable document reasoning.

2 min

Aug 21, 2026Models

Benchmark Models

Open Models Are Catching the Frontier Faster. Benchmark Scores Aren’t the Whole Contest.

SemiAnalysis sees the lag from closed-model breakthroughs to open-model benchmark parity shrinking across three AI eras. But a comparable model score still leaves a harder product question: who can turn capability into dependable agent work?

4 min