vision-language-action model
A vision-language-action (VLA) model lets a robot see, understand language, and act. It processes camera images and text instructions to decide what to do next, often predicting a short sequence of future actions called an action chunk. The model then replans after executing that chunk. Making these models robust means they can handle corrupted sensor data, adapt to different situations, and respond quickly to hazards without extra supervision.
The papers focus on making VLA models adapt their own decision process. Some methods adapt the action chunk length based on prediction confidence or scene risk, improving success under corrupted observations and in hazardous driving. Others use language as a cheap memory or synthetic demonstrations to replace human data, rescuing tasks with zero initial success. Evaluations reveal that current models struggle with spatial reasoning and long-horizon planning, highlighting the need for better adaptability and robustness.
- Papers
- 84
- Released code
- 3
- First seen
- Aug 2026
- Latest
- Nov 2026
80 papers in the last two months, against 4 in the two before.
Start here
Three papers to read first, in the order they came out- 1AI driving models go farther when action feedback updates perception
The benefit of VLM gradient insulation depends on action-token supervision and evaluation, questioning its default use in VLA training.
Nov 2026 - 2Simple retrieval beats most trained robot policies on a popular benchmark
Nearest-neighbor reuse of demonstration actions reaches 91.7% on LIBERO, showing that much benchmark success can come from matching familiar states rather than learned control.
Nov 2026 - 3Robot memory that runs by clock confuses waiting with working
Time-sampled memory makes robots mistake idle waiting for task progress, causing early stopping during null events.
Nov 2026
How fast it is moving
Often studied with
world model for agentsA predictive environment model that agents use to simulate outcomes, enabling planning, reasoning, and long-horizon task execution.22 togetherflow matchingA generative training method that learns an ordinary differential equation mapping noise to data by matching velocity fields along probability paths.22 togetheragent memoryA repository where an agent stores past interactions and outcomes to inform future decisions.13 togetherWho is working on it
The papers
Most central to this idea first, not most recent.
- Top Universitycs.RO
Robot memory that runs by clock confuses waiting with working
Time-sampled memory makes robots mistake idle waiting for task progress, causing early stopping during null events.
Nanyang Technological University · Nov 2026
- Industrycs.RO
Simple retrieval beats most trained robot policies on a popular benchmark
Nearest-neighbor reuse of demonstration actions reaches 91.7% on LIBERO, showing that much benchmark success can come from matching familiar states rather than learned control.
Sereact GmbH, Karlsruher Institut für Technologie · Nov 2026
- Big Techcs.RO
AI driving models go farther when action feedback updates perception
The benefit of VLM gradient insulation depends on action-token supervision and evaluation, questioning its default use in VLA training.
NVIDIA, Princeton University · Nov 2026
- Big Techcs.LG
Robots can improve on untrained tasks by practising diverse ones
Reinforcement learning enables a single generalist robot policy to improve across many tasks simultaneously and generalize to new ones.
ETH Zurich, MPI for Intelligent Systems, Tübingen · Nov 2026
- Independentcs.CV
Robot policies that read early vision layers handle camera shifts better
Vision-language-action policies perform better when action models access intermediate visual representations instead of only the final encoder output.
Nov 2026
- Top Universitycs.RO
Robots maintain control speed as their AI models grow tenfold
Decoupling the vision-language backbone from the action head lets humanoid control rate stay at 20 Hz regardless of model size.
XPENG Robotics, University of Washington · Nov 2026
- Independentcs.RO
Bimanual robot learns precise tasks without any robot-collected data
A two-armed robot skill system trained only on 16,151 hours of handheld-gripper human demonstrations performs long, precise manipulation tasks at a new site, averaging 78% success.
Nov 2026
- Industrycs.RO
Human corrections on rollback segments help desktop robots reach 70% success
A vision-language-action foundation model with three-stage training and Rollback reaches 93.6% success on RoboTwin 2.0.
Meituan Robotics · Nov 2026
- Big Techcs.RO
Driving models can recognize hazards yet fail to brake
Driving VLAs can encode and describe hazards yet ignore them when planning; inference-time hazard guidance restores braking without retraining.
Politecnico di Milano, Stanford University · Oct 2026
- Top Universitycs.RO
Robot AI speed depends more on action generation than model size
Action-generation strategy determines VLA inference latency on edge hardware more than model size.
National University of Singapore, 0G Labs · Oct 2026
- Research Labcs.RO
Robots handle visual changes better by reusing previously successful movements
R2A makes VLA robot policies robust to visual changes by retrieving geometric motion primitives from training experience.
VinUniversity, VinRobotics · Oct 2026
- Chinese Techcs.AI
Gameplay dataset maps tasks to subgoals for training AI agents
AceAction-5M is a multi-game dataset linking task, subgoal, and skill instructions to time-aligned gameplay visuals and keyboard-and-mouse actions.
Tencent, Jilin University · Nov 2026
- Top Universitycs.RO
Robots can anticipate physical changes without generating videos of the future
PDRVLA learns compact physical tokens from vision-language features to condition robot actions on future scene dynamics without online video generation.
Peking University, JD.com · Oct 2026
- Top Universitycs.RO
Robot policies trained on minimal data struggle on real-world tasks in distributed tests
A distributed network of locally operated robots shows frontier AI agents matching specialized robot policies without adaptation, while rankings shift across robot types and after fine-tuning.
National University of Singapore, University of Washington · Nov 2026
- Big Techcs.RO
Humanoid robots trained in simulation can navigate homes without prior mapping
A humanoid robot trained only in simulation achieves 91% success performing physical tasks in unfamiliar real homes.
Apple · Nov 2026
- Big Techcs.RO
Robots complete more two-handed tasks when AI repeatedly refines actions
Vision-language models that actively participate in action denoising outperform those that only provide static conditioning.
Peking University, The Hong Kong University of Science and Technology (Guangzhou) · Nov 2026
- Big Techcs.AI
Reasoning supervision lets action models skip decoding without losing performance
Action generation does not need to wait for reasoning text; TacitVLA matches explicit-reasoning VLA performance at up to 3.4x lower latency.
NVIDIA, New York University · Oct 2026
- Big Techcs.CV
AI agents benefit from checking both plans and imagined outcomes
Tiresias plans actions by generating candidate trajectories, ranking them, then imagining their visual consequences via a world model.
University of Washington, National University of Singapore · Nov 2026
- Top Universitycs.RO
Robots can change task strategies when their controllers change
Robot policies can adapt to new controllers by observing how a few commanded actions actually move the robot, enabling behavioral transfer without explicit controller knowledge.
Stanford University · Oct 2026
- Chinese Techcs.RO
Future 3D motion prediction boosts robot learning with fewer demonstrations
Augmenting robot action learning with future 3D motion prediction improves manipulation performance and generalization.
The Hong Kong Polytechnic University, Alibaba Group · Oct 2026
- Big Techcs.RO
Robots learn from human videos to handle unfamiliar tasks and environments
Representing actions as chains of discrete motion tokens that are reinforced by how well they predict future video frames lets unlabeled human videos train robot manipulation policies.
NVIDIA, KAIST · Oct 2026
- Big Techcs.RO
Action-aware embeddings retrieve better robot experiences for future actions
Robota-Embed jointly encodes vision, language, and action for robot experience retrieval, outperforming action-free embeddings.
NVIDIA, MIT · Oct 2026
- Chinese Techcs.RO
Systematic study reveals what matters for world modeling in robot VLAs
2D semantic representations and decoupled world model integration improve VLA robustness on long-horizon and dynamic tasks.
Chinese Academy of Sciences, University of Chinese Academy of Sciences · Oct 2026
- Research Labcs.RO
Compact robot policy uses lightweight memory to stabilize action generation
A 2.4B vision-language-action model trained only on public data is outperformed only by models about twice its size, and a register-token memory cuts pose oscillations fourfold.
Kyutai, Inria · Oct 2026
- Chinese Techcs.RO
Human demonstrations scale whole-body learning for humanoid loco-manipulation
Robot-aligned whole-body human demonstrations scale humanoid loco-manipulation training, improving task progress and producing strong benchmark and real-world results.
Alibaba Token Hub, Amap · Oct 2026
- Big Techcs.RO
Phone scans can personalize robot pickup policies through simulation
A phone scan and object images can replace real demonstrations for personalizing a VLA policy, yielding 63.9% real-world pickup success.
Georgia Institute of Technology, Waymo LLC · Oct 2026
- Academiccs.RO
Five human videos can adapt robot policies within five minutes
A 400M diffusion policy pretrained on 100 hours of egocentric human video learns new robot tasks from 5 demonstrations in under 5 minutes.
New York University · Oct 2026
- Chinese Techcs.AI
Looking Beyond Safe Actions Helps Robots Avoid Policy Dead Ends
Safe actions can lead to dead ends; this work reranks action candidates based on the safe completions they leave open.
Huawei Heisenberg Research Center, Huawei Noah’s Ark Lab · Oct 2026
- Big Techcs.RO
One Model Predicts Robot Futures and Chooses Actions
SUAVE uses a masked diffusion transformer with discrete tokens to unify video, actions, and language into one model.
Columbia University, Toyota Research Institute · Oct 2026
- AI Startupcs.RO
Dense subtask labels help robots complete long two-handed tasks
FineART, a bimanual manipulation dataset with dense subtask annotations, enables a vision-language-action model to achieve 100% success on spatial instructions.
Scale AI, Hugging Face · Oct 2026
- Academiccs.RO
One action-conditioned JEPA improves vision-language-action policies across all lifecycle stages
Juno uses a single action-conditioned JEPA to improve VLA success rates across pretraining, policy learning, and deployment.
University of Science and Technology of China, Eastern Institute of Technology, Ningbo · Oct 2026
- Big Techcs.CV
Wiring details determine whether affordance heads help or hurt VLA policies
Stop-gradient affordance head with active initialized residual bridge boosts VLA policy success to 96.2% on LIBERO.
Drexel University, Virginia Tech · Oct 2026
- Big Techcs.CVcode
Structured intermediate rewards improve robots on long, dependent tasks
Structured intermediate rewards, gated by task prerequisites and scaled by completion pace, improve long-horizon VLA training over sparse terminal rewards.
The Pennsylvania State University, Amazon AWS AI · Sept 2026
- Academiccs.RO
Stereo module lifts 2D vision-language-action models to 3D for robot manipulation
ExStereo augments pre-trained 2D Vision-Language-Action models with 3D perception using stereo vision, improving robotic manipulation success rates.
University of Southern California · Oct 2026
- Research Labcs.AI
A single corrupted observation can derail vision-language robot policies
A single corrupted observation can derail VLA robot tasks, while consistency-triggered shortening of action execution chunks improves robustness without sacrificing clean performance.
Science Tokyo, RIKEN · Sept 2026
- Big Techcs.CV
Language-Based Memory Helps Driving Models Track Earlier Road Events
AD-Memo gives autonomous-driving VLA agents reusable language memory, improving memory-dependent driving, scene question answering, and cross-model portability.
University of Illinois Urbana-Champaign, NVIDIA · Oct 2026
- Academiccs.RO
Synthetic demonstrations let robot policies escape sparse-reward failures
SynthDemo-RL generates synthetic demonstrations from simulator state, distills via SFT, and refines with PPO to achieve high success on tasks previously at 0%.
Fujitsu Limited, The Institute of Statistical Mathematics · Sept 2026
- Academiccs.RO
Adaptive action chunking improves robot control by varying horizon based on prediction reliability.
GeoAAC adapts action chunking horizon from denoising trajectory geometry, improving VLA policy success rates over fixed horizons.
Tongji University, The Hong Kong Polytechnic University · Sept 2026
- Independentcs.RO
Current robot models falter as spatial and procedural complexity rises
Current VLA models struggle with complex spatial reasoning and long-horizon procedural planning on the RoboSPA benchmark.
Sept 2026
- Chinese Techcs.CV
Language enables precise character and camera control in video worlds
Language instructions can precisely control video generation by reusing the model's existing semantics with minimal adaptation.
Tencent, National University of Singapore · Sept 2026
- Chinese Techcs.RO
Robot policies encode changed instructions but still follow scene cues
Vision-language robot policies often encode changed instructions but still follow scene-associated targets because language is weakly grounded in action selection.
HKU, CUHK(SZ) · Oct 2026
- Chinese Techcs.RO
Robot-relative 3D features improve pretrained manipulation policies across diverse tasks
Spatial Grafting binds frozen 3D reconstruction features to metric robot-relative geometry to improve pretrained robot manipulation policies.
University of Toronto, Huawei Noah’s Ark Lab · Sept 2026
- Chinese Techcs.RO
Portable RGB demonstrations can train mobile manipulation policies and reduce base-velocity errors
Portable RGB demonstrations via VOMMI train mobile manipulation policies that lower base-velocity error by 18.2% compared to robot-collected demonstrations.
Zhejiang University, Shanghai AI Lab · Oct 2026
- Chinese Techcs.CV
Driving AI adapts reasoning to risk, not just complexity
CAR-VLA adapts reasoning depth and focus using scene complexity and dynamic risk to achieve competitive driving performance.
Fudan University, Yinwang Intelligent Technology Co., Ltd · Oct 2026
- Top Universitycs.CV
Robots can generate continuous movements without a separate action network
Concertina unifies manipulation and cognition in a single diffusion vision-language model via continuous latent action tokens.
University of Sydney, TokenRhythm Technologies · Nov 2026
- Chinese Techcs.RO
Robot fleets can finish more work with fewer active robots
Episode-level admission control restores throughput when robot fleets overwhelm shared brain-serving caches.
Huawei Inc. · Nov 2026
- Chinese Techcs.RO
BiDex-100 tests robot policies across 106 coordinated two-handed tasks
BiDex-100 provides 106 bimanual dexterous manipulation tasks across five capability axes with matched out-of-domain variants and 8,080 teleoperated demonstrations.
Zhejiang University, Ant Group · Oct 2026
- Top Universitycs.CV
Unified world action model jointly learns perception, prediction, and planning
A single model can jointly reconstruct 3D hand and camera motion, predict action-conditioned video futures, and plan goal-directed manipulation trajectories, with unified training improving all three.
HKUST (GZ), Primatix · Oct 2026
- Chinese Techcs.AI
Large-scale dataset and world-model RL improve embodied navigation in open worlds
Embodied world agents improve open-world navigation-planning via offline pretraining on a 200K-sample dataset and interactive reinforcement-learning post-training inside a video world model.
Tencent Hunyuan · Oct 2026
- Chinese Techcs.CL
Multimodal decision models output structured choices in a single pass
Intern-Decision makes structured multimodal decisions in a single forward pass, achieving high accuracy and low latency.
Shanghai AI Lab, Shanghai Jiao Tong University · Oct 2026
- Research Labcs.CL
Generating user guides can improve web agents’ action selection
Jointly decoding a guide and action improves web agent element selection, and guides causally drive actions.
Independent Researcher, University of Chinese Academy of Sciences · Sept 2026
- Big Techcs.RO
Semantic messaging helps distributed robots coordinate long manipulation tasks
DuoMind uses hierarchical VLM orchestrator and VLA action model with semantic communication to improve multi-robot coordination performance.
University of California, Davis, Microsoft Research · Oct 2026
- Academiccs.RO
Predictive visual models improve action generation for generalist robot manipulation
InternW0-Δ jointly models visual dynamics and action generation for robot manipulation, outperforming prior methods across benchmarks.
Shanghai AI Laboratory · Sept 2026
- Top Universitycs.RO
Robots Can Revise Visual Plans Instead of Starting Over
Revisable Temporal Planning revises a robot's visual plan after execution feedback by continuing from a saved intermediate generation state.
Beihang University, Peking University · Sept 2026
- Research Labcs.CVcode
Dual-horizon foresight improves UAV navigation from language instructions
ForeFly predicts both proximal and route-critical futures to improve aerial navigation from language instructions.
Institute of Automation, Chinese Academy of Sciences, University of Chinese Academy of Sciences · Sept 2026
- Top Universitycs.LG
Replay-free continual learning method prevents forgetting in vision-language-action models
SAMBAR prevents catastrophic forgetting in VLA models during continual learning without needing prior task data.
University of California Berkeley · Oct 2026
- Chinese Techcs.RO
Robots can use human videos before learning their own controls
Robot policies can learn reusable, three-dimensional motion representations from videos without robot command labels, then adapt them to different robot controls.
Hong Kong Embodied AI Lab, CUHK · Oct 2026
- Top Universitycs.RO
Touch-directed curiosity helps robots discover useful manipulation skills
Tactile-driven curiosity lets robots learn manipulation and grasp policies without task rewards or demonstrations, and improves post-training of VLA models.
ETH Zürich, University of California, Berkeley · Oct 2026
- Top Universitycs.RO
Agent-side memory steers stateless robots through long manipulation tasks
Task memory for long-horizon manipulation can live outside the action policy; an agent-steered, stateless RGB action model reaches 76.3% on LIBERO-Mem.
KU Leuven, Meituan Inc. · Sept 2026
- Big Techcs.RO
Finger-mounted tactile sensors outperform wrist cameras for contact-rich robot tasks
Finger-mounted touch sensors can replace wrist cameras for contact-rich robot manipulation, matching or exceeding camera-aided vision policies in the tested tasks.
Toyota Research Institute · Nov 2026
- Chinese Techcs.RO
Robot policy outperforms larger generative models with a quarter of the parameters
La-JEPA trains robot policies from scratch in a pretrained JEPA feature space and matches or beats much larger generative-backbone policies with fewer parameters and faster inference.
Huawei Technologies Ltd., University of Toronto · Nov 2026
- Industrycs.AI
Robots can act at 50 Hz while updating visual understanding once a second
Leap-VLA decouples slow semantic from fast reactive control, reusing cached VLM context to match same-frequency performance.
Leapmotor · Nov 2026
- Industrycs.RO
Benchmark reveals when robotic agents truly learn and when they just retry
Self-improving robot agents do not necessarily learn from experience; apparent gains can come from retries or luck, and learned skills do not always transfer.
Luma AI · Oct 2026
- Chinese Techcs.RO
AI models can reason better by predicting videos of outcomes
RynnUnify is a 16B unified embodied model that combines understanding with long-horizon visual planning via interleaved video-language reasoning.
DAMO Academy, Alibaba Group, Hupan Lab · Oct 2026
- Academiccs.RO
Robots can borrow a video model's foresight and act 21 times faster
Compressing a video world model's internal features and distilling them into an action model lets a robot act about 21 times faster at run time without the video model.
Harbin Institute of Technology, Shenzhen · Nov 2026
- Independentcs.RO
Video generators can control robots without producing video, cutting computing costs
Tokenizing robot actions as single video patch tokens lets a pretrained video diffusion model act as a policy without generating videos at inference.
Oct 2026
- Big Techcs.CV
Sensorimotor alignment predicts robot task success offline
Sensorimotor alignment, an offline metric comparing sensory and motor representation neighborhoods, predicts robot task success across embodied model families.
Rice University, NVIDIA · Oct 2026
- Big Techcs.RO
ACCRUE helps robots learn new assembly tasks without forgetting old ones
ACCRUE transfers lightweight actor-critic networks across tasks for efficient continual off-policy RL with minimal forgetting.
NVIDIA, KAIST · Oct 2026
- Top Universitycs.RO
Classifier gradients let frozen robot policies adapt to new bodies without demonstrations
A lightweight embodiment classifier guides a frozen flow-based robot policy to new dynamics, raising average success from 72% to 80% in LIBERO simulation.
UC Berkeley · Oct 2026
- Chinese Techcs.RO
Human demonstrations teach humanoids coordinated whole-body manipulation without teleoperation
EgoHumanoid-V2 transfers coordinated whole-body loco-manipulation skills from egocentric human demonstrations to humanoid robots.
OpenDriveLab at The University of Hong Kong, Alibaba Group · Oct 2026
- Chinese Techcs.CV
One-step action generation and asynchronous pipeline achieve real-time world action models
RealtimeWAM enables near-lossless real-time action generation with 25x speedup via one-step denoising and asynchronous pipelining.
Nanyang Technological University, Beihang University · Oct 2026
- Independentcs.CV
Grounding foundation model surpasses larger vision-language models on precise perception and robotics
GroundingPI, a 4B model, achieves state-of-the-art visual grounding across 34 benchmarks and improves robotic manipulation and autonomous driving when used as a perception backbone.
Oct 2026
- Top Universitycs.RO
Forecasting 3D scene motion improves dexterous robot manipulation
Jointly forecasting 3D point trajectories of scene and hands improves dexterous robotic manipulation.
POSTECH, KAIST · Oct 2026
- Big Techcs.RO
Recurrent memory policy improves robot manipulation on tasks requiring spatial recall, counting, and timing
ReCAT uses structured recurrent memory with Mamba-2 and causal attention to achieve high success on memory-dependent robot manipulation tasks.
University of Edinburgh, Karlsruhe Institute of Technology · Oct 2026
- Big Techcs.RO
Benchmark exposes gap between choosing tools and using them
HumanoidToolBench reveals gaps between tool selection and task execution in humanoid policies.
Seoul National University, University of Massachusetts Amherst · Oct 2026
- Industrycs.RO
Caching frozen model states makes forward-only robot adaptation much faster
VLA-ZO adapts vision-language-action models to distribution shifts 25x faster than baseline zeroth-order optimization.
UNIST · Oct 2026
- Top Universitycs.RO
Handheld demonstrations improve robot policies without repeated robot execution
HIL-UMI improves VLA robot policies via human-in-the-loop data collection without physical robot deployment.
Xi’an Jiaotong University, National Key Laboratory for Multimedia Information Processing · Sept 2026
- Top Universitycs.ROcode
One video world model transfers physical dynamics across robot bodies
A single video model trained on diverse human and robot data can simulate physics for unseen embodiments zero-shot.
Princeton University · Aug 2026
- Big Techcs.RO
Humans intervene when robots stall, not when they err
Adding optimistic bonuses to human intervention transitions improves robot learning efficiency by 10-50%.
University of Washington, Toyota Research Institute · Nov 2026
- Big Techcs.RO
Contact-preserving retargeting improves robot task success from 13% to 83%
Contact-anchored retargeting with explicit force targets preserves demonstrated contact far better than kinematic methods and improves task success.
Carnegie Mellon University, Amazon Frontier AI & Robotics (FAR) · Oct 2026
- Chinese Techcs.RO
Scoring imagined futures and actions before execution triples robot success rates
Scoring several imagined robot action plans before execution, by action smoothness, agreement between the action and its own predicted motion, and task progress, picks better plans than executing what the model proposes first.
Huawei Technologies Canada, University of British Columbia · Nov 2026
- Top Universitycs.RO
Unlabelled navigation videos can teach robots how scenes change as they move
OpenNWM learns universal latent actions from action-free video to generalize navigation world models across environments.
CASIA, University of Chinese Academy of Sciences · Nov 2026
- Big Techcs.CV
AI models can transfer actions between human and robot videos
DreamX repurposes a pretrained video diffusion model to learn compact latent actions that transfer across embodiments and achieve state-of-the-art on LARYBench.
KAIST, NVIDIA · Nov 2026
- Big Techcs.RO
Rolling predictions make robot replanning 4.5 times faster
Rolling-WAM distributes video-action denoising across replanning cycles to achieve 4.5x faster replanning without sacrificing manipulation performance.
University of Southern California, Brown University · Sept 2026
Concepts are extracted from each paper and reused across the corpus, so this page grows on its own as the desk reads.