Full archive

Benchmark: Latest AI News

Search reporting on AI markets, models, products, companies, policy, and culture.

Showing 1-2 of 2Results matching "k-ID"

August 2026

2 stories

Aug 22, 2026

AI Safety Scores Can Reward Models for Refusing Too Much

A study involving the UK AI Security Institute argues that combined benchmark scores can hide a direct trade-off between blocking harmful requests and answering harmless ones. Its proposed fixes are cheaper tests and anomaly checks, but its sandbagging evidence comes from models directly told to act cautious. The three dimensions the analysis identifies Refusal strictness: how readily a model blocks requests.

3 min readRead story

Benchmark Models

Aug 22, 2026

AWS’s RAG Cost Cut Comes With a 19% Latency Bill

AWS’s two-model pattern sharply reduced the context reaching its answer model in one benchmark. The tradeoff is another inference step, a modest quality decline, and results that may not transfer to a company’s own documents. AWS is not promising that RAG can become cheaper without a sacrifice.

3 min readRead story