Full archive

Benchmark: Latest AI News

Search reporting on AI markets, models, products, companies, policy, and culture.

Showing 1-10 of 10Results matching "Lean"

Today

1 story

Artificial Analysis Clarifies Astra’s 67-Point Coding Score Is a Codex System Result

The updated methodology makes the score a clearer measure of a deployable coding agent. It also leaves a central question unanswered: how much performance comes from Astra itself versus the software layer around it.

7 hours ago

5 min readRead story

Earlier this week

1 story

Benchmark Models

Anthropic’s Fable 5.1 Takes Benchmark Lead, but Its Top Setting Costs More Per Task

Artificial Analysis found Anthropic’s newest general model reached its highest measured intelligence score, while the token use required at maximum effort raised the cost of its own evaluation tasks.

Sep 2, 2026

4 min readRead story

Last week

5 stories

Benchmark Models

Hack The Box Benchmark: Best Human Team Cleared 36 Challenges; Top AI Team Reached 32

The latest benchmark points to a useful division of labor in cyber work: agents can accelerate solving, but elite performance still depends on people choosing paths and checking results.

Aug 30, 2026

3 min readRead story

Benchmark Models

Chatbots Debunked Foreign Falsehoods About 75% of the Time, Beating Search Results

The result makes chatbots a potentially stronger starting point for investigating state-spread claims than a search-results page. It does not make their answers self-validating: language, citations and product design still shape the outcome.

Aug 30, 2026

4 min readRead story

Benchmark Models

ReViSQL-K2.6 Hits 91.37% on Cleaned SQL Test, but Not a Live Database

The result argues that a focused model, repaired examples, and domain-specific rewards can rival elaborate SQL-agent stacks. Its remaining test is whether that recipe transfers from curated academic data to corporate databases.

Aug 27, 2026

3 min readRead story

Benchmark Products

Beijing Humanoid Games Put Practical Work to the Test; Only 3 of 12 Finish Fire Course

The games paired spectacle with multi-step chores and emergency work, where task switching, human control and offboard computing remain central constraints.

Aug 25, 2026

2 min readRead story

Benchmark Products

Tiangong Ultra Runs 100m in 8.86 Seconds, Then Hits a Stopping Mat

The Beijing race shows a sharp jump in humanoid sprint performance, but its finish also exposed a basic operational constraint: Tiangong Ultra needed a thick mat to stop and caught fire after impact.

Aug 25, 2026

3 min readRead story

August 2026

3 stories

Benchmark Tools

InferenceX Adds 11 Telemetry Views to AgentX, Exposing What Benchmark Curves Hide

The new exploration layer makes cache setup, bursty subagents and queue behavior inspectable, but its best-curve design means readers must still examine each point’s underlying configuration before treating a curve as a like-for-like comparison.

Aug 23, 2026

3 min readRead story

Benchmark Models

Inherent Says Its 27B Science Agent Beat OpenAI and Anthropic on Paper Replication

The company’s result centers on reproducing known findings, not making discoveries. Its next test is whether that training approach can move from replication to reliable new science.

Aug 22, 2026

2 min readRead story

Benchmark Infrastructure

Nvidia Dynamo’s Agentic Speedups Target the Work Around the Model

The reported gains come from changing how serving systems route, retain and stream state under concurrency. The next challenge is whether these AgentX-specific improvements hold across production mixes and unfinished scheduling work.

Aug 18, 2026

4 min readRead story