Full archive

Benchmark: Tools AI News

Search reporting on AI markets, models, products, companies, policy, and culture.

Showing 1-6 of 6

Today

1 story

5 hours agoTools

Benchmark Tools

LlamaIndex and Kaggle Launch a Document Benchmark for Cost and Long Files

ExtractBench publishes a broader test for enterprise document extraction, while its launch results include company-reported figures for LlamaIndex’s own product.

2 min

Last week

2 stories

Aug 28, 2026Tools

Benchmark Tools

Lemmalog Turns Agent Memory Into Datalog State, Cutting LongMemEval Context 38-Fold

The experimental system moves long-running agent work away from recalling old notes and toward maintaining conclusions with explicit support. Its early benchmark results suggest a substantial context-saving path, while leaving the probabilistic extraction step as the central weakness.

3 min

Aug 28, 2026Tools

Benchmark Tools

Perplexity Search API Sweeps Artificial Analysis Test, but Medium Context Wins

The result gives developers a concrete retrieval-quality lead to test, while showing that sending an agent more page text is not automatically the best route to better answers.

3 min

August 2026

3 stories

Aug 23, 2026Tools

Benchmark Tools

InferenceX Adds 11 Telemetry Views to AgentX, Exposing What Benchmark Curves Hide

The new exploration layer makes cache setup, bursty subagents and queue behavior inspectable, but its best-curve design means readers must still examine each point’s underlying configuration before treating a curve as a like-for-like comparison.

3 min

Aug 22, 2026Tools

Benchmark Tools

SemiAnalysis Says AgentX Drove 50-Plus Upstream Fixes for AI Agents

The claimed contribution is not a faster model kernel. It is a test workload that makes state retention, routing and data movement visible—and leaves open whether its fixes generalize beyond AgentX’s replay matrix.

3 min

Aug 22, 2026Tools

Benchmark Tools

LinkedIn Measures AI Code Review Against Merged Code

The company’s reported acceptance rate is a useful outcome measure, but the more transferable design is a controllable review pipeline: local rules, pre-posting filters and infrastructure built for monitoring.

2 min