Black Forest Labs Releases FLUX 3 Action: A 7B Open-Weights World Action Model That Tops RoboLab-120

來源原標題

Black Forest Labs Releases FLUX 3 Action: A 7B Open-Weights World Action Model That Tops RoboLab-120

作者

Asif Razzaq

原始標籤

Agentic AI · AI Infrastructure · AI Shorts · Artificial Intelligence · Computer Vision · Editors Pick · Embedding Model · Language Model · Large Language Model · Machine Learning · New Releases · Open Source · Physical AI · Python · Robotics · Staff · Tech News · Technology · Vision Language Model

原始連結

https://www.marktechpost.com/2026/09/24/black-forest-labs-releases-flux-3-action-a-7b-open-weights-world-action-model-that-tops-robolab-120/

摘要原文

Black Forest Labs (BFL), the lab behind the FLUX image models, has released FLUX 3 Action . It is a 7B open-weights World Action Model (WAM) for robot control. The model reads camera frames, robot state and a text instruction. It then predicts future video frames and the next chunk of actions together. On the RoboLab-120 leaderboard , it ranks first at 42.92% task success. Is it deployable? Yes, with conditions. The DROID policy needs about 32 GB of GPU memory in BF16 on an H200. It fits 24 GB cards with FP8 quantization and text encoder offload. The FLUX Kommunity License allows non-commercial use. Open robot policies usually force a choice. WAMs like NVIDIA’s Cosmos 3 Nano lead RoboLab at 36.8%, but predicting video is expensive. VLAs like π0.5 are fast, but reach only 28.0%. On a B200, BFL measured that Cosmos 3 Nano (FP8) needs about 4.7x more processing time than π0.5 (BF16) per second of robot motion. FLUX 3 Action keeps joint video and action prediction. BFL closes the speed gap with a smaller backbone and distillation instead. FLUX 3 Action is derived from the multimodal FLUX 3 backbone. Pretraining used image, video and audio data, and video made up over 95% of training tokens. Text, video and robot state are encoded into tokens. The backbone’s future tokens are decoded into video frames, and its action tokens into robot actions. Midtraining mixed pretraining data (36.95% of samples) with action-aligned video (63.05%). The action data covered game recordings, egocentric human hand video, handheld grippers and teleoperation across 14 embodiments. Most robot data uses a shared 50-dimension end-effector action space called EE50. Pretraining matters a lot here. Without it, DROID-only training stayed below 1% on RoboLab. With pretraining, the same protocol reached 11.6%. RoboLab-120 has 120 tabletop tasks in Isaac Sim, with 10 trials each on a DROID -style Franka setup. That is a 6.1 percentage point lead with 56% fewer parameters than Cosmos 3 Nano. The 42.92% figure is the leaderboard entry. BFL’s multi-seed mean for the guidance-distilled FP8 checkpoint is 42.24% ± 0.36. Real hardware results follow the same pattern. Positronic Robotics ran a blind evaluation on a Franka arm with 10 DROID tasks and 3 attempts each. FLUX 3 Action completed 28 of 30 attempts (93.3%). Cosmos 3 Nano scored 27/30, DreamZero 20/30 and π0.5 13/30. BFL ships the DROID policy in 3 recipes, each in BF16 and FP8: Against Cosmos 3 Nano in FP8, the base and guidance-distilled checkpoints run 1.52x to 3.95x faster across consumer, workstation and datacenter GPUs. Each call yields 32 actions at 15 Hz, or 2.13 seconds of motion. π0.5 yields 1.0 second per call. So BFL reports speed as real-time factor, not per-call latency. In FP8, the step-distilled checkpoint beats π0.5 by 1.34x to 2.28x on workstation and datacenter GPUs. On an RTX 5090, it is slower than π0.5. BFL also tested hybrid control with GPT 6 Astra, following the Su et al. (2026) setup. The reasoner can execute, edit or replace the policy’s predicted actions. With FLUX 3 Action and low reasoning effort, the hybrid solved 90% of episodes at $8.77 and 8m 08s per success. Pure Astra at maximum effort solved 100%, but cost $13.47 and 16m 23s per success. AI teams can fine-tune FLUX 3 Action on their own demonstrations. BFL published a DROID recipe and an SO-101 LoRA recipe . Its docs show an SO-101 pick-and-place skill learned from about 200 demonstrations. With NVIDIA, BFL integrated the model natively into Hugging Face LeRobot , and it supports edge deployment on NVIDIA Jetson. The docs also include game-playing and simulated drone examples. The model outputs joint targets with no built-in velocity, force or workspace limits. Your application must enforce those limits. Check out the full technical report , model weights , GitHub repo and docs . All credit goes to the researcher of this project. Also, feel free to follow us on Twitter and don’t forget to join our 150k+ML SubReddit and Subscribe to our Newsletter . Wait! are you on telegram? now you can join us on telegram as well. Need to partner with us for promoting your GitHub Repo OR Hugging Face Page OR Product Release OR Webinar etc.? Connect with us The post Black Forest Labs Releases FLUX 3 Action: A 7B Open-Weights World Action Model That Tops RoboLab-120 appeared first on MarkTechPost .