Businesspublished

Foxglove Adds Cosmos Data Search as Robot Builders Struggle for Reliable Work

Foxglove’s new search tool is meant to speed the data and evaluation loop, while robot makers still face a harder test: dependable commercial performance.

By 2 min read
Foxglove Adds Cosmos Data Search as Robot Builders Struggle for Reliable Work

Listen to this story

The audio brief

About 1:34
0:001:34
Read transcript
Foxglove is adding a natural-language search tool for robotics data, built on Nvidia’s open-weight Cosmos world model. The aim is practical: help engineers find the right visual and lidar records faster, then use them to evaluate and debug robot models in simulations and real-world tests. That matters because the bottleneck is not just better models. Robotics teams are dealing with dense, difficult-to-search datasets, while high-quality training data remains scarce. Faster data triage could shorten the loop between collecting examples, finding failures, and trying a new evaluation or reinforcement-learning scenario. But the larger industry test is whether improving physical capability can become dependable commercial work. Robots are already being deployed in solar-farm construction, industrial operations, and autonomous excavation. Bedrock is starting with excavation to study manipulation in real construction environments, and says it plans an intelligence layer across construction machines. Those deployments can produce revenue and operating data, although data tied to one task may not transfer well to a general-purpose humanoid. That leaves a strategic split. Wayve’s Alex Kendall favors models that are more hardware-agnostic, arguing that fast-changing sensors and components make it too early to commit to one robot platform. Genesis AI’s Théophile Gervet argues the opposite: hardware and artificial intelligence should be co-designed while the field is still young. Foxglove may speed the development loop, but the open question is whether better data access can overcome the deeper problem: making robots reliably useful beyond narrow environments.

Story brief

3 key points

Foxglove is adding natural-language search across robotics datasets, using Nvidia’s open-weight Cosmos world model to help teams find records for evaluations and simulations. The tool targets a costly bottleneck: scarce, difficult-to-debug visual and lidar data slows model iteration even as commercial robots generate more task-specific information. Revenue-generating deployments in excavation, construction, solar,...

  1. 01

    Foxglove’s search tool is designed to speed data triage and debugging for robotics evaluations and simulations.

  2. 02

    Robotics teams still face scarce high-quality data spanning dense visual and lidar records.

  3. 03

    Bedrock is starting with excavation to study manipulation in real-world construction environments.

The race to build broadly useful robots is colliding with a more immediate test: turning improving physical capabilities into reliable, value-creating commercial work. Foxglove is addressing part of that problem with a tool that lets engineers search robotics data using natural-language queries for evaluations and simulations.

Foxglove built the product on Nvidia’s open-weight Cosmos world model. Its stated goal is to help model builders triage and debug data faster, so they can iterate more quickly on evaluations and simulations.

The problem is not simply locating records. Robotics teams must manage dense visual and lidar data, while developers seek more diverse datasets, different training approaches and better reinforcement-learning scenarios. High-quality training data remains scarce, and generalized robots able to do any task are still far off, according to the article.

Vertical deployments can produce revenue and real-world operating data, even if task-specific data may not be diverse enough to advance a general-purpose model. Bedrock CTO Kevin Peterson said excavation is its starting point for understanding manipulation in the wild; the company plans an intelligence layer across construction machines.

Autonomous-vehicle companies are relatively advanced partly because they can collect relevant data from human-driven cars and because avoiding contact differs from manipulating the physical environment. Tesla is developing Optimus, while Wayve and Uber have launched humanoid-focused robotics labs. Wayve CEO Alex Kendall expects data, simulation and ML-operations infrastructure to be shared, though simulator world models will need different post-training for different robot bodies.

Kendall argues that fast-changing sensors and components make it too early to commit to a hardware platform, and that a general model should be more hardware-agnostic. Genesis AI CEO Théophile Gervet takes the opposite view: the field is early enough to co-design hardware and AI. Faster data search may help teams move through their development loop, but the industry has not settled that strategic choice.

Sources

  1. techcrunch.comRobot brain builders are pushing out of their GPT-2 era | TechCrunch