AI Development
Vision-Language-Action Model (VLA)
A model that takes camera images and a natural-language instruction and outputs robot actions directly.
In depth
A model that takes camera images and a natural-language instruction and outputs robot actions directly. Google DeepMind's RT-2 introduced the term by co-fine-tuning a vision-language model on robot trajectories, encoding each action as text tokens the model emits like words. Because the model keeps its web-scale pretraining, it can follow commands that never appeared in the robot training data. Gemini Robotics is a current example of the VLA approach.
Primary source: arxiv.org
Example
Google DeepMind's RT-2 introduced the term by co-fine-tuning a vision-language model on robot trajectories, encoding each action as text tokens the model emits like words.
Go deeper at Developers Digest
Hands-on guides, comparisons, and tutorials that cover AI Development.
FAQ
Common questions
What is Vision-Language-Action Model (VLA)?
A model that takes camera images and a natural-language instruction and outputs robot actions directly.
Why does Vision-Language-Action Model (VLA) matter for AI developers?
Vision-Language-Action Model (VLA) sits in the AI Development part of the AI stack. Understanding it helps you make better decisions when building, debugging, and shipping AI features.
Where can I learn more about Vision-Language-Action Model (VLA)?
Developers Digest publishes tutorials and videos that cover AI Development topics including Vision-Language-Action Model (VLA). Check the blog and YouTube channel for hands-on walkthroughs.
Related
Related terms
AI Development
Chinchilla Scaling
The finding from DeepMind's 2022 Chinchilla paper that, for a fixed compute budget, model size and training tokens should grow in equal proportion: double the parameters, double the data.
AI Development
Model Collapse
A phenomenon where AI models trained on AI-generated data progressively lose quality and diversity over generations.
AI Development
Model Card
A model card is a short document published with a trained machine learning model that explains its intended uses, its limitations, and how it performs across different conditions and groups.
Put this concept to work
Get Smarter About AI Dev
New tutorials, open-source projects, and deep dives on coding agents - delivered weekly.
One email per weekReal code, not theoryFree forever