Foxglove Adds Cosmos Data Search as Robot Builders Struggle for Reliable Work
Foxglove’s new search tool is meant to speed the data and evaluation loop, while robot makers still face a harder test: dependable commercial performance.
Listen to this story
The audio brief
Story brief
3 key pointsFoxglove is adding natural-language search across robotics datasets, using Nvidia’s open-weight Cosmos world model to help teams find records for evaluations and simulations. The tool targets a costly bottleneck: scarce, difficult-to-debug visual and lidar data slows model iteration even as commercial robots generate more task-specific information. Revenue-generating deployments in excavation, construction, solar,...
- 01
Foxglove’s search tool is designed to speed data triage and debugging for robotics evaluations and simulations.
- 02
Robotics teams still face scarce high-quality data spanning dense visual and lidar records.
- 03
Bedrock is starting with excavation to study manipulation in real-world construction environments.
The race to build broadly useful robots is colliding with a more immediate test: turning improving physical capabilities into reliable, value-creating commercial work. Foxglove is addressing part of that problem with a tool that lets engineers search robotics data using natural-language queries for evaluations and simulations.
Foxglove built the product on Nvidia’s open-weight Cosmos world model. Its stated goal is to help model builders triage and debug data faster, so they can iterate more quickly on evaluations and simulations.
The problem is not simply locating records. Robotics teams must manage dense visual and lidar data, while developers seek more diverse datasets, different training approaches and better reinforcement-learning scenarios. High-quality training data remains scarce, and generalized robots able to do any task are still far off, according to the article.
Vertical deployments can produce revenue and real-world operating data, even if task-specific data may not be diverse enough to advance a general-purpose model. Bedrock CTO Kevin Peterson said excavation is its starting point for understanding manipulation in the wild; the company plans an intelligence layer across construction machines.
Autonomous-vehicle companies are relatively advanced partly because they can collect relevant data from human-driven cars and because avoiding contact differs from manipulating the physical environment. Tesla is developing Optimus, while Wayve and Uber have launched humanoid-focused robotics labs. Wayve CEO Alex Kendall expects data, simulation and ML-operations infrastructure to be shared, though simulator world models will need different post-training for different robot bodies.
Kendall argues that fast-changing sensors and components make it too early to commit to a hardware platform, and that a general model should be more hardware-agnostic. Genesis AI CEO Théophile Gervet takes the opposite view: the field is early enough to co-design hardware and AI. Faster data search may help teams move through their development loop, but the industry has not settled that strategic choice.
Sources
- techcrunch.comRobot brain builders are pushing out of their GPT-2 era | TechCrunch