
TL;DR
Black Forest Labs released FLUX 3, a single multimodal model trained jointly on images, video, and audio that also drives robots on Audi production lines. Here is what it does, how it works, and how to try it.
Black Forest Labs released FLUX 3 on July 23, and it is not just another image model update. FLUX 3 is a single multimodal foundation model trained jointly on images, video, and audio from the start - and its backbone is already driving robots on real Audi production lines through a partnership with mimic robotics.
The announcement hit 428 points on Hacker News and introduces what the company calls "Real World Models": a unified approach where one underlying representation of the world supports image generation, video synthesis, audio prediction, and physical action. The thesis is that these are not separate problems. They are different projections of the same reality, and a model that learns from all of them simultaneously builds a better understanding than any single-modality approach.
FLUX 3 is built on Self-Flow, BFL's architecture for aligning multimodal generation and understanding within the same model. The key insight: if you train one model on images, video, and audio jointly, each modality constrains the others. The sound has to match the impact. The motion has to obey the mass. The future has to follow from the past. Those mutual constraints produce a better world model than training on any single modality.
The model is the scaled-up production version of Self-Flow, trained on tens of millions of hours of general video content plus hundreds of thousands of hours focused on human and robot manipulation tasks.
FLUX 3 generates video with synchronized audio up to 20 seconds in a single pass. It handles text-to-video, image-to-video (animating a still frame or using images as visual references), video-to-video (carrying a character into a new scene), keyframe-to-video for controlled transitions, and agentic chaining that stitches clips into multi-shot sequences. It supports multilingual dialogue, a wide range of visual styles from camcorder footage to animation, and strong typography generation.
Early preference evaluations show FLUX 3 Video winning against most competitors:
| Comparison | Preference Rate |
|---|---|
| vs Grok Imagine Video | 69% |
| vs Kling v3 Pro | 60% |
| vs Happy Horse v1 | 59% |
| vs Happy Horse 1.1 | 57% |
| vs Seedance 2.0 / Gemini Omni Flash | 52% |
| vs Runway Gen-4.5 | 77% |
| vs Luma Ray 3.2 | 93% |
The company notes these are preliminary results and expects improvements during the early access phase. The model is already strong at human facial expressions, associating sounds with physical events, and multilingual output. Combined sequences can run several minutes with consistent characters.
FLUX 3 Image shows significant improvement over the FLUX 2 series, particularly in handling complex prompts and text rendering. It produces high-accuracy text in multiple languages across a wide range of styles and aspect ratios. Image early access opens in the coming weeks.
The most surprising capability: FLUX 3's world understanding extends to physical action. BFL gave mimic robotics early access to the backbone, and together they built FLUX-mimic, a video-action model deployed on Audi production lines.
The approach trains a lightweight action decoder on top of intermediate features from FLUX 3's video prediction path. Because the backbone already understands physics - mass, motion, contact, cause and effect - the action decoder only needs to map tasks onto what the model already knows. This yields dramatically better sample efficiency: the Self-Flow approach reaches a given success rate in half the training steps, and FLUX-mimic reports up to 10x sample efficiency over vision-language-action models.
Benchmarks show the action decoder outperforms previous VLA models even with a completely frozen FLUX backbone. When finetuned together, FLUX-mimic achieves state-of-the-art success rates on manipulation tasks.
The backbone runs at under 80ms on a single NVIDIA RTX 5090. With mimic's optimized deployment stack, the end-to-end system reaction time is 101ms - in the same order of magnitude as human visual reaction time. This makes it viable for real-time production work.
On the factory floor, FLUX-mimic is handling tasks that conventional automation cannot touch: kitting parts into structured trays, inserting electronic control units into tight fixtures, assembling components, and handling soft, flexible materials like seals and cables. The model naturally recovers from failure - a missed grasp corrects itself and completes the task, behavior that was never in the demonstration set.
From the archive
Jul 24, 2026 • 6 min read
Jul 24, 2026 • 9 min read
Jul 23, 2026 • 9 min read
Jul 23, 2026 • 13 min read
FLUX 3 Video with audio generation is available now through early access. You can request access via BFL's API or private weight access. The API follows a standard REST interface documented at docs.bfl.ai.
Image generation early access opens in the coming weeks. An open-weight version called FLUX 3 Dev is planned.
The API supports text-to-video and image-to-video generation with synchronous audio output. Typical usage:
curl -X POST https://api.bfl.ai/v1/generate \
-H "Content-Type: application/json" \
-H "X-Key: YOUR_API_KEY" \
-d '{
"prompt": "A chef plating a dish in a busy kitchen, cinematic lighting",
"width": 1280,
"height": 720,
"duration": 10
}'
Check the docs for the current endpoint shapes, which may change during early access.
FLUX 3 represents a shift in how foundation models are built. The unification of image, video, audio, and action into a single backbone has implications for anyone building AI applications:
One model, many outputs. Instead of stitching together separate image, video, and audio models, FLUX 3 produces synchronized multimodal output from a single call. This simplifies pipelines for content creation, simulation, and media generation.
The content-robotics convergence. If content generation and physical action run on the same representation, then advances in video quality directly improve robotics capabilities and vice versa. The 101ms reaction time on commodity GPU hardware suggests this is not just theoretical.
Open-weight roadmap. The planned FLUX 3 Dev release means developers will eventually be able to run, fine-tune, and deploy the model on their own infrastructure. When combined with the 80ms inference on an RTX 5090, this opens on-device and edge use cases.
Self-Flow as a paradigm. The approach of aligning generation and representation quality within one model could influence how future multimodal models are designed. The evidence that adding action prediction temporarily degrades generation quality but fully recovers while gaining new capability is notable for anyone building general-purpose models.
FLUX 3 is in early access, not a stable product. The benchmarks are preliminary. Video evaluations use 10-second 720p clips with audio. Image generation is not yet publicly available. The open-weight version is announced but not shipped. Latency and quality will change as the serving infrastructure matures. Pricing has not been published. Treat today's numbers as directional, not contractual.
Read next
MiniMax launched H3, an omni-modal generation model that takes text, image, video, and audio input and outputs 2K video with native stereo sound at 0.80 CNY per second. Open weights are promised in the coming days.
8 min readxAI released Grok Imagine Image 2.0 on August 7 as the new Quality Mode on grok.com and mobile, ranked second worldwide on both text-to-image and image-editing leaderboards. A 2.0 preview build is already callable through Vercel's AI Gateway with the AI SDK, before xAI's own API access goes live.
6 min readGoogle DeepMind's Gemini Robotics ER 2 is now publicly available via the Gemini API. It watches live video feeds to track task progress, orchestrates VLA models as tools, and coordinates multiple robots. The numbers: 57.4% progress classification, 91.3% moment finding at 0.96s offset.
6 min readTechnical content at the intersection of AI and development. Building with AI agents, Claude Code, and modern dev tools - then showing you exactly how it works.
Google's frontier model family. Gemini 2.5 Pro has 1M token context and top-tier coding benchmarks. Gemini 3 Pro pushes...
View ToolOpen-source OpenAI API replacement. Runs LLMs, vision, voice, image, and video models on any hardware - no GPU require...
View ToolUnified API for 200+ models. One API key, one billing dashboard. OpenAI, Anthropic, Google, Meta, Mistral, and more. Aut...
View ToolDeepSeek's reasoning-first model built for agents. First model to integrate thinking directly into tool use. Ships along...
View ToolInstall Ollama and LM Studio, pull your first model, and run AI locally for coding, chat, and automation - with zero cloud dependency.
Getting StartedSet up Codex Chronicle on macOS, manage permissions, and understand privacy, security, and troubleshooting.
Getting StartedUse opus, sonnet, haiku, and best to switch models easily.
Claude Code
In my latest video, I delve into the fascinating world of LAVA, a groundbreaking multimodal model that's setting new standards in local inference capabilities. My exploration begins with a...

#IDEFECS #HuggingFace #gpt4 Links: https://huggingface.co/spaces/HuggingFaceM4/idefics_playground https://huggingface.co/models?other=multimodal https://huggingface.co/blog/idefics https://huggin...

In this video I show you the new multimodal model by Meta AI that allows you to input speech or text and get a host of different outputs from speech-to-speech translation to speech-to-text...

MiniMax launched H3, an omni-modal generation model that takes text, image, video, and audio input and outputs 2K video...

xAI released Grok Imagine Image 2.0 on August 7 as the new Quality Mode on grok.com and mobile, ranked second worldwide...

WeatherNext Cyclones adds a full day of lead time to tropical cyclone forecasts - roughly a decade of meteorological pro...

DeepSeek re-post-trained V4 Flash into an agent workhorse: Terminal Bench 82.7, DeepSWE 54.4, native Responses API, and...

Google DeepMind's Gemini Robotics ER 2 is now publicly available via the Gemini API. It watches live video feeds to trac...

Google DeepMind's Gemini Robotics 2 family gives humanoid robots whole-body control, dexterous hands, and multi-robot te...

New tutorials, open-source projects, and deep dives on coding agents - delivered weekly.