Full archive

Infrastructure AI News

Search reporting on AI markets, models, products, companies, policy, and culture.

Showing 1-18 of 23Results matching "GPU-as-a-Service"

Today

1 story

HPE Issues Oracle Warrants in AI Network Deal With Financing and Telemetry

The newly detailed terms add stock warrants, support, financing capabilities and network-monitoring work around Oracle’s prospective global Juniper deployment.

17 hours ago

2 min readRead story

Last week

5 stories

Benchmark Infrastructure

InferenceX Ranks B300 First for Qwen3.5 at 15,815 Tokens per Second

The live ranking gives operators a matched speed-and-cost comparison for a long single-turn chat request, not a verdict on every production inference pattern.

Sep 5, 2026

2 min readRead story

Infrastructure

HyperVault Targets $7.4 Billion for a 1-Gigawatt AI Campus in Hyderabad

The proposed campus would give TCS’s infrastructure unit a large physical base for GPU-heavy AI workloads. The next test is converting a secured site and planned capacity into service for AI companies and hyperscalers.

Sep 5, 2026

3 min readRead story

Partnership Infrastructure

Crusoe Signs Reported $13 Billion, Five-Year AI Cloud Deal With Jane Street

The reported agreement gives the trading firm access to Crusoe’s cloud infrastructure for AI training and inference, but it does not connect the $13 billion commitment to a specific site or amount of capacity.

Sep 3, 2026

2 min readRead story

Partnership Infrastructure

SpaceX’s External Compute Deals Add a Potential Rival for CoreWeave

A confirmed Anthropic arrangement and reported outside-customer contracts put more large-scale AI capacity into the market. The unanswered question is whether it can become a repeatable cloud service.

Sep 2, 2026

2 min readRead story

Launch Infrastructure

Broadcom Validates Five AI Model Families for VMware’s On-Premises Model Service

The update gives enterprises a path to run models from NVIDIA, Google, NEC, Alibaba Cloud and Z.ai inside their own infrastructure, with new sharing, routing and code-isolation services around them.

Aug 31, 2026

2 min readRead story

August 2026

12 stories

Funding Infrastructure

Blue Owl Leads $2.4 Billion IREN GPU Financing Tied to Hardware Delivery

IREN has a large debt commitment for its Canadian AI-cloud buildout, but the amount becomes available alongside delivered and commissioned hardware—not as one immediate cash payment.

Aug 30, 2026

2 min readRead story

Launch Infrastructure

OpenRelay Routes AI Inference Across GPUs, TPUs and Trainium Through One API

The early-access network aims to let developers buy performance rather than a particular accelerator, but its cost-savings claims and ability to deliver consistent service across mixed infrastructure remain unproven.

Aug 29, 2026

3 min readRead story

Enterprise adoption Infrastructure

Salesforce Uses SageMaker Placement Controls to Meet 2-AZ Agentforce Standard, Keep 8x Savings

The configuration separates model-level resilience from an endpoint’s infrastructure footprint, but balanced placement still depends on GPU capacity in each target Availability Zone.

Aug 28, 2026

3 min readRead story

Open release Infrastructure

Snowflake Open-Sources Semi-Persistence With Sub-Second Single-GPU vLLM Swaps

The release treats GPU model copies as disposable while retaining weights in CPU memory, aiming to let many specialized models share costly accelerator capacity without long reload delays.

Aug 27, 2026

3 min readRead story

Benchmark Infrastructure

Heidi Cuts ASR GPUs From 16 to 4 With CUDA MPS, Holding Sub-Second Latency

The production design turns spare capacity in small speech-inference requests into concurrency, but it depends on workload-specific scheduling and protections against MPS failure modes.

Aug 27, 2026

3 min readRead story

Launch Infrastructure

Deepgram Sends SageMaker Billing and GPU Metrics to CloudWatch Without Container Egress

The release makes vendor-level cost and capacity signals visible inside AWS tools, but teams still need different metric streams for billing, feature usage and an individual endpoint’s GPU headroom.

Aug 27, 2026

3 min readRead story

Partnership Infrastructure

AWS Plans 2 Million Nvidia GPUs for 2027–28 and Federal AI Factories

The partnership reaches beyond GPU supply into CPUs, networking and AWS’s own Trainium chips. The largest capacity commitment remains a future deployment, making execution on the shared infrastructure the central test.

Aug 26, 2026

3 min readRead story

Partnership Infrastructure

Cisco and Nvidia Move Secure AI Factory to Rack Scale, Targeting September Orders

The package shifts the sales pitch from individual GPUs to a pre-validated system. Cisco still must show that its promised deployment acceleration holds up in customer data centers.

Aug 25, 2026

4 min readRead story

Partnership Infrastructure

Cisco Adds Supermicro Rack-Scale Systems to Its NVIDIA AI Factory for October Rollout

The partnership turns Cisco’s AI infrastructure offer into a more complete rack-to-fabric package, combining dense GPU servers, networking and liquid cooling for customers building larger AI clusters.

Aug 25, 2026

2 min readRead story

Launch Infrastructure

AWS Brings Ray Into SageMaker HyperPod With Recovery Tools and Tiered Cache on EKS

The launch moves several operational tasks behind SageMaker Studio while tying Ray teams to a HyperPod-on-EKS setup and its required add-ons.

Aug 24, 2026

3 min readRead story

Launch Infrastructure

NVIDIA Adds BlueField-4 Scale-In for 800 Gb/s AI-Factory Infrastructure Offload

The new layer targets a growing bottleneck around GPU clusters: moving, securing and governing data without consuming the host resources assigned to AI workloads. Its performance case remains NVIDIA-supplied.

Aug 24, 2026

3 min readRead story

Launch Infrastructure

Nvidia Puts Groq 3 LPX Into Production for Faster AI-Agent Responses

The first Nebius deployment will test Nvidia’s argument that specialized token generation can make long, tool-using AI sessions more responsive while leaving GPUs at the center of the system.

Aug 24, 2026

3 min readRead story

Load more stories5 more next

Superpower Daily

Your reading space

Infrastructure AI News

Today

HPE Issues Oracle Warrants in AI Network Deal With Financing and Telemetry

Last week

InferenceX Ranks B300 First for Qwen3.5 at 15,815 Tokens per Second

HyperVault Targets $7.4 Billion for a 1-Gigawatt AI Campus in Hyderabad

Crusoe Signs Reported $13 Billion, Five-Year AI Cloud Deal With Jane Street

SpaceX’s External Compute Deals Add a Potential Rival for CoreWeave

Broadcom Validates Five AI Model Families for VMware’s On-Premises Model Service

August 2026

Blue Owl Leads $2.4 Billion IREN GPU Financing Tied to Hardware Delivery

OpenRelay Routes AI Inference Across GPUs, TPUs and Trainium Through One API

Salesforce Uses SageMaker Placement Controls to Meet 2-AZ Agentforce Standard, Keep 8x Savings

Snowflake Open-Sources Semi-Persistence With Sub-Second Single-GPU vLLM Swaps

Heidi Cuts ASR GPUs From 16 to 4 With CUDA MPS, Holding Sub-Second Latency

Deepgram Sends SageMaker Billing and GPU Metrics to CloudWatch Without Container Egress

AWS Plans 2 Million Nvidia GPUs for 2027–28 and Federal AI Factories

Cisco and Nvidia Move Secure AI Factory to Rack Scale, Targeting September Orders

Cisco Adds Supermicro Rack-Scale Systems to Its NVIDIA AI Factory for October Rollout

AWS Brings Ray Into SageMaker HyperPod With Recovery Tools and Tiered Cache on EKS

NVIDIA Adds BlueField-4 Scale-In for 800 Gb/s AI-Factory Infrastructure Offload

Nvidia Puts Groq 3 LPX Into Production for Faster AI-Agent Responses