Full archive

Benchmark: Latest AI News

Search reporting on AI markets, models, products, companies, policy, and culture.

Showing 1-8 of 8Results matching "Select AI"

Earlier this week

1 story

Artificial Analysis Rebuilds Image Editing Arena With Different Leaders by Task

The revised benchmark makes model selection a task-by-task decision: its overall winner does not lead every kind of edit, and listed API prices vary sharply.

Sep 2, 2026

3 min readRead story

Last week

3 stories

Benchmark Models

ReViSQL-K2.6 Hits 91.37% on Cleaned SQL Test, but Not a Live Database

The result argues that a focused model, repaired examples, and domain-specific rewards can rival elaborate SQL-agent stacks. Its remaining test is whether that recipe transfers from curated academic data to corporate databases.

Aug 27, 2026

3 min readRead story

Benchmark Infrastructure

Databricks Says Async Save Cut 20B-Parameter PyTorch Checkpoints to 9 Seconds on 32 H100s

The AI Runtime components pair distributed recovery with local-NVMe data caching. The remaining operational test is whether training jobs save their input position as well as their model state.

Aug 27, 2026

3 min readRead story

Benchmark Infrastructure

OpenAI’s Jalapeño Claims 1.5–1.9x More AI Work Per Watt, Faces 2027 Scale Test

The custom chip gives OpenAI an early efficiency claim against available Nvidia systems, but production qualification, broader workloads and a small initial rollout will determine whether it becomes a meaningful serving platform.

Aug 25, 2026

4 min readRead story

August 2026

4 stories

Benchmark Tools

SemiAnalysis Says AgentX Drove 50-Plus Upstream Fixes for AI Agents

The claimed contribution is not a faster model kernel. It is a test workload that makes state retention, routing and data movement visible—and leaves open whether its fixes generalize beyond AgentX’s replay matrix.

Aug 22, 2026

3 min readRead story

Benchmark Models

Inherent Says Its 27B Science Agent Beat OpenAI and Anthropic on Paper Replication

The company’s result centers on reproducing known findings, not making discoveries. Its next test is whether that training approach can move from replication to reliable new science.

Aug 22, 2026

2 min readRead story

Benchmark Models

AI Safety Scores Can Reward Models for Refusing Too Much

A study involving the UK AI Security Institute argues that combined benchmark scores can hide a direct trade-off between blocking harmful requests and answering harmless ones. Its proposed fixes are cheaper tests and anomaly checks, but its sandbagging evidence comes from models directly told to act cautious.

Aug 22, 2026

3 min readRead story

Benchmark Models

Open Models Are Catching the Frontier Faster. Benchmark Scores Aren’t the Whole Contest.

SemiAnalysis sees the lag from closed-model breakthroughs to open-model benchmark parity shrinking across three AI eras. But a comparable model score still leaves a harder product question: who can turn capability into dependable agent work?

Aug 21, 2026

4 min readRead story