CoreWeave Launches Forge to Connect AI Deployment, Monitoring and Improvement

CoreWeave says AI search training raised accuracy while cutting tool calls by 30.24%

CoreWeave says a joint AI search-training test with NVIDIA and you.com raised BrowseComp accuracy from 36.97% to 45.45%, while reducing average tool calls by 30.24%. The October 5, 2026 disclosure details results from capabilities introduced at Fully Connected 2026, including infrastructure that loads updated models into live deployments during training.

The workflows sit within CoreWeave Forge, the development environment announced September 30. Model Distillation, RL Rollouts and a programmable training API connect production feedback to training and back to serving users.

In reinforcement learning, the model generates attempts—called rollouts—that feed the next training step. Updated weights then return to serving. RL Rollouts lets teams retain their trainer, reward logic and environment while CoreWeave handles inference, using NVIDIA Dynamo with vLLM support.

CoreWeave says new checkpoints can load without interrupting requests already underway. After the first upload, teams can send only changed weights rather than full snapshots. The service also returns training metadata, including token IDs and the probabilities assigned to generated tokens.

The joint validation post-trained NVIDIA Nemotron 3.5 Lightning using supervised and reinforcement learning with you.com’s search tools. Checkpoint loading was approximately 15 times faster than traditional redeployment, CoreWeave says. But it credits the workload gains to better search tooling, model refinement and surrounding software changes—not rollout infrastructure alone.

Model Distillation is the managed route: it trains a smaller model to reproduce a stronger model’s behavior. Agent Lens captures production traffic for training. Teams can relabel weak answers, test models and training settings, then compare candidates against the model already in production.

CoreWeave points to Method’s model for navigating automated bank phone systems. In August 2026, Method refreshed production data and relabeled examples with GPT-5.6 Sol. The resulting model won 57.5% of head-to-head evaluations against its production predecessor, CoreWeave says. The base model stayed the same: Llama 3.1 8B.

The programmable API offers more control: teams write Python training loops while CoreWeave manages the infrastructure. They can mix supervised learning from example answers with reinforcement learning that rewards successful outcomes. The API remains in limited preview, with an official launch planned for later in 2026.

CoreWeave cautions against retraining before diagnosing a failure. Missing context, retrieval problems, prompts, broken tools or serving behavior can resemble model-quality issues. Changing weights will not fix faults elsewhere in the system.

CoreWeave Opens Agent Lens Preview to Find AI-Agent Failures and Check Fixes

Teams running AI agents can now try a tool designed to turn live failures into tests for the next version, rather than investigate each conversation separately. CoreWeave opened Agent Lens in public preview on September 30, 2026. Its launch announcement describes a connected workflow for finding recurring problems, diagnosing them and checking proposed fixes before release.

Agent Lens works from traces: records of an agent’s inputs, outputs, model responses and tool calls. Its conversation view presents those records as readable dialogue. Product managers and subject-matter experts can review what happened, while engineers can expand individual turns to inspect the execution details behind them.

CoreWeave says the system analyzes the full production collection rather than a small, manually selected sample. It groups conversations with the same underlying failure, even when their wording, tool sequence or visible error differs. Each group links back to source traces and representative examples, giving teams evidence to inspect rather than just a changed dashboard metric.

Those groups update as new traces arrive. Teams can rank problems by frequency, changes over time and affected workflows. Agent Lens also groups requests by user intent, showing which tasks customers want and where the agent falls short. CoreWeave presents the two views as complementary: a popular task may deserve investment, while a rarer failure may demand attention because of safety or compliance risk.

Finding a suspicious pattern is only the start. Agent Lens lets teams create custom LLM judges—language models used to score agent behavior—based on failures found in production. Domain experts define the expected response and score representative examples, establishing the standards the automated judge should apply.

The tool compares human labels with judge scores and surfaces disagreements. Teams can examine cases the judge wrongly flags or misses, clarify scoring rules and refine its criteria before applying it broadly. Once aligned with those standards, the judge can score new production traces automatically. The workflow therefore includes checking the evaluator, not simply accepting its first verdict.

A candidate fix can change a prompt, model, tool configuration or code. Teams first compare its response with the original production case, then run it against the full evaluation set. That second step is intended to catch regressions elsewhere, rather than treating success on one replay as enough to ship.

CoreWeave says coding agents such as Claude Code can connect through Skills and MCP integrations. With appropriate permissions, they can retrieve failure groups, inspect traces, propose changes, make test calls and summarize evaluation results for review. Teams remain in control of what gets approved and promoted; automated investigation is not presented as unrestricted release authority.

Agent Lens is part of CoreWeave Forge. Its product page also describes a connection to Weights & Biases Models, allowing recurring production failures to inform future training runs. That extends the evidence beyond an immediate prompt or tool fix and into model development.

Hosted cloud: Agent Lens is available in public preview on CoreWeave’s hosted cloud.

Dedicated and on-premises: The launch announcement says both deployment options are coming soon, despite the product page’s broader deployment language.

Introductory access: Insights and online LLM judges are free through the end of 2026. The launch announcement does not specify their pricing afterward.