Full archive

Benchmark: Infrastructure AI News

Search reporting on AI markets, models, products, companies, policy, and culture.

Showing 1-7 of 7Results matching "SemiAnalysis"

Today

1 story

2 hours agoInfrastructure

Benchmark Infrastructure

InferenceX Ranks GB200 First for MiniMax M3, While MI355X Has Lower Token Cost

The live AgentX result gives operators a comparable speed-and-price snapshot at one responsiveness target, but the ranking can shift with serving software and does not settle the wider configuration trade-offs.

3 min

Earlier this week

1 story

Sep 2, 2026Infrastructure

Benchmark Infrastructure

InferenceX Puts GB300 First for MiniMax M2.7, but Only on a Fixed Chat Test

The new ranking gives infrastructure teams a comparable speed and cost snapshot, but its single-turn design does not test the multi-step agent work MiniMax highlights for M2.7.

2 min

Last week

2 stories

Aug 25, 2026Infrastructure

Benchmark Infrastructure

OpenAI’s Jalapeño Claims Up to 1.9x Efficiency Gain, but Leaves Nvidia Training Intact

The Broadcom co-developed inference processor is headed for deployment by year-end. Its published gains are meaningful, but they exclude model training and Nvidia’s Vera Rubin platform.

3 min

Aug 24, 2026Infrastructure

Benchmark Infrastructure

NVIDIA Says Vera Rubin Delivers 30x More Agentic Throughput per Megawatt, Pending Review

The preliminary comparison shifts attention from fixed prompt benchmarks toward the power required to keep long, tool-using AI sessions responsive.

3 min

August 2026

3 stories

Aug 18, 2026Infrastructure

Benchmark Infrastructure

LMCache Reworks the Cache Plumbing That Can Stall Long-Running Agents

The changes address a specific failure mode in long, concurrent agent sessions: reusable model state can fill a shared pool before any request makes progress. The reported gains are promising, but they come from targeted validations rather than a broad production benchmark.

3 min

Aug 18, 2026Infrastructure

Benchmark Infrastructure

Nvidia Dynamo’s Agentic Speedups Target the Work Around the Model

The reported gains come from changing how serving systems route, retain and stream state under concurrency. The next challenge is whether these AgentX-specific improvements hold across production mixes and unfinished scheduling work.

4 min

Aug 18, 2026Infrastructure

Benchmark Infrastructure

AgentX Replays Claude Code Sessions to Test AI Serving Systems

The replay dataset is designed to measure infrastructure behind agentic coding workloads, not whether a model writes better code. Its value depends on whether synthetic traces preserve the traffic patterns operators need to serve.

3 min