Black Forest Labs Details Robot Model, Claims Top Score Ahead of Public Release

FLUX 3 Action was already in early access. The new benchmark figures and technical details sharpen its pitch, but developers still lack the promised weights and license terms.

By 4 min read
Black Forest Labs Details Robot Model, Claims Top Score Ahead of Public Release
Black Forest Labs Details Robot Model, Claims Top Score Ahead of Public Release

Listen to this story

The audio brief

About 1:29
0:001:29
Read transcript
Black Forest Labs says its FLUX 3 Action robot model scored forty-two point nine two percent on RoboLab-120, a simulated benchmark covering one hundred twenty tasks. That would put it ahead of the previous public leader, at thirty-nine percent. But the result had not appeared on NVIDIA’s public leaderboard when the company’s claim was reported, so it has not yet been independently confirmed there. The seven-billion-parameter model takes camera images, the robot’s current state and a task description. It then predicts thirty-two actions, along with how the scene may change. After the robot acts, it observes the scene again and repeats. Black Forest Labs calls this a “World Action Model”: it predicts both what may happen and what the robot should do. The company says FLUX 3 Action runs one point four three times faster than NVIDIA’s sixteen-billion-parameter Cosmos 3 Nano Policy. For a demonstration, the company fine-tuned the model using about two hundred remotely controlled pick-and-place episodes. A selected video shows the robot retrying after a failed attempt, but that does not establish reliable recovery in other settings. Developers still cannot download the promised weights. Black Forest Labs says its planned release will include code, fine-tuning materials and reproducible examples, but it has announced no release date or license terms. The key test is whether outside teams can reproduce the benchmark and make the model work reliably on their own robots.

Story brief

3 key points

Black Forest Labs is positioning FLUX 3 Action as a vision-based control model that predicts both robot movements and how the scene will change. The company reports 42.92% on RoboLab-120, versus the prior public leader’s 39.0%, but NVIDIA’s leaderboard had not posted the result when VentureBeat checked. At 7 billion parameters, it could interest robotics developers, yet no public weights or license are available for...

  1. 01

    The model takes camera images, robot state and a task, then outputs 32 actions plus a prediction of the scene; it repeats after observing the result.

  2. 02

    Black Forest Labs says the 7B model runs 1.43 times faster than NVIDIA’s 16B Cosmos3-Nano-Policy; smaller models use non-comparable tests.

  3. 03

    A policy demonstration used about 200 teleoperated pick-and-place episodes; selected clips, including a retry, do not establish reliability elsewhere.

A robot model once limited to early-access partners now comes with a performance claim. Its maker, Black Forest Labs, says the 7-billion-parameter FLUX 3 Action model scored 42.92% on a robotics simulation benchmark, topping the previous public leader. The result gives developers a reason to look closely, but the promised model weights are not yet public.

From camera view to robot movement

FLUX 3 Action takes recent camera images, the robot’s current state and a task description. It then produces the next 32 actions alongside a prediction of how the scene will change. After moving, the robot observes its surroundings again and repeats the process. The aim is to make each set of movements responsive to what the camera sees next, rather than treating the entire task as a fixed sequence.

The design draws on Black Forest Labs’ work with images, video and audio. During additional training, the Action model learns to predict future video frames and robot actions together. It is an attempt to put knowledge of how a scene changes to work controlling a machine. The company calls this a “World Action Model”; the useful distinction is that it predicts both what might happen next and what the robot should do.

The simulation result, in context

Black Forest Labs says FLUX 3 Action achieved a 42.92% overall success rate on NVIDIA’s RoboLab-120, a simulated test spanning 120 robotics tasks. That would beat the 39.0% score of OASIS WAM, which held the top overall position immediately before this result. Black Forest Labs also puts its model 6.1 percentage points ahead of NVIDIA’s Cosmos 3. Those are company-supplied results: NVIDIA’s public leaderboard had not yet added FLUX 3 Action when VentureBeat checked before publication.

Black Forest Labs’ reported RoboLab result
42.92%FLUX 3 Action success rate

Black Forest Labs reports this overall success rate on NVIDIA’s simulated RoboLab-120 tasks; the public leaderboard had not yet been updated with its result.

The size and speed comparison is narrower than a claim to be the smallest robot model. Black Forest Labs says Action has 7 billion parameters, against 16 billion for NVIDIA’s Cosmos3-Nano-Policy, and runs 1.43 times faster. Other robotics models are smaller still, but they are tested on different mixes of simulated and real-world work. A RoboLab lead therefore does not establish which model will perform best across robots, hardware and tasks.

What the demonstrations can show

For its robot demonstrations, Black Forest Labs says it fine-tuned a policy using about 200 episodes in which a person remotely controlled a robot through related pick-and-place tasks. The company says the objects in the test videos were absent from that training set. In one company-selected clip, the robot fails an attempt and tries again. That is a useful glimpse of the behavior the company wants, not proof that recovery will work reliably in other settings.

The company has also tested the approach beyond robot arms. It says task-specific versions flew real drones and finished the computer game Doom without a death. Black Forest Labs describes these as early experiments, not production capabilities. Neither example settles whether a team can adapt the model to an unfamiliar robot and keep it performing consistently outside a selected demonstration.

The release developers are waiting for

This is not Action’s first appearance. In its July FLUX 3 announcement, Black Forest Labs said the Action version was available for early access and that broader availability and open-weight versions would follow. The new account adds specific benchmark and design details, but it should not be mistaken for a public download. Black Forest Labs told VentureBeat it plans to release weights, code, a fine-tuning recipe, benchmarks and reproducible examples, including one built around the SO-101 robot and Hugging Face’s LeRobot framework.

The public weights and their license terms remain unavailable, and Black Forest Labs has not announced an Action API or its pricing. Those gaps matter to teams considering whether they can fine-tune and run the model themselves, especially for commercial use. For now, the benchmark describes a promising simulation result; the planned release would let outside developers test how much of that promise survives on their own machines.

Sources

  1. globenewswire.comBlack Forest Labs Unveils FLUX 3, A New Multimodal Frontier Model For Visual Intelligence
  2. venturebeat.comBlack Forest Labs debuts FLUX 3 Action, an open-weights AI robotics model that tops the leaderboard at half the size of its competition

Loading discussion...

YOUR READING SPACE

Notifications