Foxglove Adds Cosmos Data Search as Robot Builders Struggle for Reliable Work

The race to build broadly useful robots is colliding with a more immediate test: turning improving physical capabilities into reliable, value-creating commercial work. Foxglove is addressing part of that problem with a tool that lets engineers search robotics data using natural-language queries for evaluations and simulations.

Foxglove built the product on Nvidia’s open-weight Cosmos world model. Its stated goal is to help model builders triage and debug data faster, so they can iterate more quickly on evaluations and simulations.

The problem is not simply locating records. Robotics teams must manage dense visual and lidar data, while developers seek more diverse datasets, different training approaches and better reinforcement-learning scenarios. High-quality training data remains scarce, and generalized robots able to do any task are still far off, according to the article.

Vertical deployments can produce revenue and real-world operating data, even if task-specific data may not be diverse enough to advance a general-purpose model. Bedrock CTO Kevin Peterson said excavation is its starting point for understanding manipulation in the wild; the company plans an intelligence layer across construction machines.

Autonomous-vehicle companies are relatively advanced partly because they can collect relevant data from human-driven cars and because avoiding contact differs from manipulating the physical environment. Tesla is developing Optimus, while Wayve and Uber have launched humanoid-focused robotics labs. Wayve CEO Alex Kendall expects data, simulation and ML-operations infrastructure to be shared, though simulator world models will need different post-training for different robot bodies.

Kendall argues that fast-changing sensors and components make it too early to commit to a hardware platform, and that a general model should be more hardware-agnostic. Genesis AI CEO Théophile Gervet takes the opposite view: the field is early enough to co-design hardware and AI. Faster data search may help teams move through their development loop, but the industry has not settled that strategic choice.