
TL;DR
Black Forest Labs released FLUX 3, a single multimodal model trained jointly on images, video, and audio that also drives robots on Audi production lines. Here is what it does, how it works, and how to try it.
Black Forest Labs released FLUX 3 on July 23, and it is not just another image model update. FLUX 3 is a single multimodal foundation model trained jointly on images, video, and audio from the start - and its backbone is already driving robots on real Audi production lines through a partnership with mimic robotics.
The announcement hit 428 points on Hacker News and introduces what the company calls "Real World Models": a unified approach where one underlying representation of the world supports image generation, video synthesis, audio prediction, and physical action. The thesis is that these are not separate problems. They are different projections of the same reality, and a model that learns from all of them simultaneously builds a better understanding than any single-modality approach.
FLUX 3 is built on Self-Flow, BFL's architecture for aligning multimodal generation and understanding within the same model. The key insight: if you train one model on images, video, and audio jointly, each modality constrains the others. The sound has to match the impact. The motion has to obey the mass. The future has to follow from the past. Those mutual constraints produce a better world model than training on any single modality.
The model is the scaled-up production version of Self-Flow, trained on tens of millions of hours of general video content plus hundreds of thousands of hours focused on human and robot manipulation tasks.
FLUX 3 generates video with synchronized audio up to 20 seconds in a single pass. It handles text-to-video, image-to-video (animating a still frame or using images as visual references), video-to-video (carrying a character into a new scene), keyframe-to-video for controlled transitions, and agentic chaining that stitches clips into multi-shot sequences. It supports multilingual dialogue, a wide range of visual styles from camcorder footage to animation, and strong typography generation.
Early preference evaluations show FLUX 3 Video winning against most competitors:
| Comparison | Preference Rate |
|---|---|
| vs Grok Imagine Video | 69% |
| vs Kling v3 Pro | 60% |
| vs Happy Horse v1 | 59% |
| vs Happy Horse 1.1 | 57% |
| vs Seedance 2.0 / Gemini Omni Flash | 52% |
| vs Runway Gen-4.5 | 77% |
| vs Luma Ray 3.2 | 93% |
The company notes these are preliminary results and expects improvements during the early access phase. The model is already strong at human facial expressions, associating sounds with physical events, and multilingual output. Combined sequences can run several minutes with consistent characters.
FLUX 3 Image shows significant improvement over the FLUX 2 series, particularly in handling complex prompts and text rendering. It produces high-accuracy text in multiple languages across a wide range of styles and aspect ratios. Image early access opens in the coming weeks.
The most surprising capability: FLUX 3's world understanding extends to physical action. BFL gave mimic robotics early access to the backbone, and together they built FLUX-mimic, a video-action model deployed on Audi production lines.
The approach trains a lightweight action decoder on top of intermediate features from FLUX 3's video prediction path. Because the backbone already understands physics - mass, motion, contact, cause and effect - the action decoder only needs to map tasks onto what the model already knows. This yields dramatically better sample efficiency: the Self-Flow approach reaches a given success rate in half the training steps, and FLUX-mimic reports up to 10x sample efficiency over vision-language-action models.
Benchmarks show the action decoder outperforms previous VLA models even with a completely frozen FLUX backbone. When finetuned together, FLUX-mimic achieves state-of-the-art success rates on manipulation tasks.
The backbone runs at under 80ms on a single NVIDIA RTX 5090. With mimic's optimized deployment stack, the end-to-end system reaction time is 101ms - in the same order of magnitude as human visual reaction time. This makes it viable for real-time production work.
On the factory floor, FLUX-mimic is handling tasks that conventional automation cannot touch: kitting parts into structured trays, inserting electronic control units into tight fixtures, assembling components, and handling soft, flexible materials like seals and cables. The model naturally recovers from failure - a missed grasp corrects itself and completes the task, behavior that was never in the demonstration set.
Newsletter
Get the weekly deep dive
Tutorials on Claude Code, AI agents, and dev tools, delivered free every week.
From the archive
Jul 24, 2026 • 9 min read
Jul 23, 2026 • 9 min read
Jul 23, 2026 • 9 min read
Jul 22, 2026 • 8 min read
FLUX 3 Video with audio generation is available now through early access. You can request access via BFL's API or private weight access. The API follows a standard REST interface documented at docs.bfl.ai.
Image generation early access opens in the coming weeks. An open-weight version called FLUX 3 Dev is planned.
The API supports text-to-video and image-to-video generation with synchronous audio output. Typical usage:
curl -X POST https://api.bfl.ai/v1/generate \
-H "Content-Type: application/json" \
-H "X-Key: YOUR_API_KEY" \
-d '{
"prompt": "A chef plating a dish in a busy kitchen, cinematic lighting",
"width": 1280,
"height": 720,
"duration": 10
}'
Check the docs for the current endpoint shapes, which may change during early access.
FLUX 3 represents a shift in how foundation models are built. The unification of image, video, audio, and action into a single backbone has implications for anyone building AI applications:
One model, many outputs. Instead of stitching together separate image, video, and audio models, FLUX 3 produces synchronized multimodal output from a single call. This simplifies pipelines for content creation, simulation, and media generation.
The content-robotics convergence. If content generation and physical action run on the same representation, then advances in video quality directly improve robotics capabilities and vice versa. The 101ms reaction time on commodity GPU hardware suggests this is not just theoretical.
Open-weight roadmap. The planned FLUX 3 Dev release means developers will eventually be able to run, fine-tune, and deploy the model on their own infrastructure. When combined with the 80ms inference on an RTX 5090, this opens on-device and edge use cases.
Self-Flow as a paradigm. The approach of aligning generation and representation quality within one model could influence how future multimodal models are designed. The evidence that adding action prediction temporarily degrades generation quality but fully recovers while gaining new capability is notable for anyone building general-purpose models.
FLUX 3 is in early access, not a stable product. The benchmarks are preliminary. Video evaluations use 10-second 720p clips with audio. Image generation is not yet publicly available. The open-weight version is announced but not shipped. Latency and quality will change as the serving infrastructure matures. Pricing has not been published. Treat today's numbers as directional, not contractual.
Read next
Meta's Muse Image is now in Meta AI, but it is not a public model API. Here is what the launch confirms, what remains preview-only, and how developers should evaluate it.
8 min readMistral's new 8B parameter model enables robots to navigate complex environments using only a camera and natural language commands. Here's what it does, how it works, and what the benchmarks actually mean.
5 min readxAI's Grok 4.5 ships at $2/$6 per million tokens with 80 TPS speeds, a 500k context window, and benchmark results that put it in the Opus and GPT 5.5 tier. What actually shipped, how the pricing compares, and when it makes sense over Claude, GPT, or Gemini.
7 min readTechnical content at the intersection of AI and development. Building with AI agents, Claude Code, and modern dev tools - then showing you exactly how it works.
Google's frontier model family. Gemini 2.5 Pro has 1M token context and top-tier coding benchmarks. Gemini 3 Pro pushes...
View ToolOpen-source OpenAI API replacement. Runs LLMs, vision, voice, image, and video models on any hardware - no GPU require...
View ToolUnified API for 200+ models. One API key, one billing dashboard. OpenAI, Anthropic, Google, Meta, Mistral, and more. Aut...
View ToolDeepSeek's reasoning-first model built for agents. First model to integrate thinking directly into tool use. Ships along...
View ToolInstall Ollama and LM Studio, pull your first model, and run AI locally for coding, chat, and automation - with zero cloud dependency.
Getting StartedSet up Codex Chronicle on macOS, manage permissions, and understand privacy, security, and troubleshooting.
Getting StartedUse opus, sonnet, haiku, and best to switch models easily.
Claude Code
In my latest video, I delve into the fascinating world of LAVA, a groundbreaking multimodal model that's setting new standards in local inference capabilities. My exploration begins with a...

In this video I show you the new multimodal model by Meta AI that allows you to input speech or text and get a host of different outputs from speech-to-speech translation to speech-to-text...

#IDEFECS #HuggingFace #gpt4 Links: https://huggingface.co/spaces/HuggingFaceM4/idefics_playground https://huggingface.co/models?other=multimodal https://huggingface.co/blog/idefics https://huggin...

Meta's Muse Image is now in Meta AI, but it is not a public model API. Here is what the launch confirms, what remains pr...

A new multi-model orchestration system routes requests across open-weight models to match frontier performance at reduce...

Terence Tao published a deep mathematical digestion of the Jacobian conjecture counterexample discovered by Claude Fable...

Kimi K3 is available through Moonshot first-party surfaces, OpenRouter, Cloudflare Workers AI, and agent harnesses like...

Kimi K3 brings 2.8 trillion parameters, native vision, a 1M-token context window, and long-horizon agent workflows. Here...

Kimi K3 adds native vision, a 1M-token window, and longer agent runs, but K2.7 remains cheaper and easier to deploy. Her...

New tutorials, open-source projects, and deep dives on coding agents - delivered weekly.