Full archive

Benchmark: Tools AI News

Search reporting on AI markets, models, products, companies, policy, and culture.

Showing 1-6 of 6

Today

1 story

6 hours ago

LlamaIndex and Kaggle Launch a Document Benchmark for Cost and Long Files

ExtractBench publishes a broader test for enterprise document extraction, while its launch results include company-reported figures for LlamaIndex’s own product.

2 min readRead story

Last week

2 stories

Benchmark Tools

Aug 28, 2026

Lemmalog Turns Agent Memory Into Datalog State, Cutting LongMemEval Context 38-Fold

The experimental system moves long-running agent work away from recalling old notes and toward maintaining conclusions with explicit support. Its early benchmark results suggest a substantial context-saving path, while leaving the probabilistic extraction step as the central weakness.

3 min readRead story

Benchmark Tools

Aug 28, 2026

Perplexity Search API Sweeps Artificial Analysis Test, but Medium Context Wins

The result gives developers a concrete retrieval-quality lead to test, while showing that sending an agent more page text is not automatically the best route to better answers.

3 min readRead story

August 2026

3 stories

Benchmark Tools

Aug 23, 2026

InferenceX Adds 11 Telemetry Views to AgentX, Exposing What Benchmark Curves Hide

The new exploration layer makes cache setup, bursty subagents and queue behavior inspectable, but its best-curve design means readers must still examine each point’s underlying configuration before treating a curve as a like-for-like comparison.

3 min readRead story

Benchmark Tools

Aug 22, 2026

SemiAnalysis Says AgentX Drove 50-Plus Upstream Fixes for AI Agents

The claimed contribution is not a faster model kernel. It is a test workload that makes state retention, routing and data movement visible—and leaves open whether its fixes generalize beyond AgentX’s replay matrix.

3 min readRead story

Benchmark Tools

Aug 22, 2026

LinkedIn Measures AI Code Review Against Merged Code

The company’s reported acceptance rate is a useful outcome measure, but the more transferable design is a controllable review pipeline: local rules, pre-posting filters and infrastructure built for monitoring.

2 min readRead story