world model for agents
Imagine an agent, like a robot or game character, that builds a mental simulator of its world. This "world model" lets it predict what will happen if it takes an action, so it can plan better without trying everything in reality. Think of it as a private video game running in the agent's head, where it can test moves before committing.
The papers show that naive world models often fail: they confuse visually identical situations, ignore tiny action-driven changes, or break with unseen teammates. Researchers fix this by injecting hidden state from past history, forcing the model to recover which action was taken, adding 3D depth, or building worlds from code with persistent memory. Some even predict task progress instead of pixels. The common thread is that reliable world models must look beyond surface observations to capture true dynamics, generalization, and long-term consistency.
- Papers
- 113
- Released code
- 2
- First seen
- Aug 2026
- Latest
- Nov 2026
109 papers in the last two months, against 4 in the two before.
Start here
Three papers to read first, in the order they came out- 1World model simulator works across 22 robot platforms, enables policy learning
PrimeSim turns a pretrained video generator into an action-conditioned, multiview world model that simulates robot manipulation across embodiments at 10.1 FPS.
Nov 2026 - 2Driving simulators follow planned paths more faithfully with overhead views
BirdDreams jointly generates perspective and bird's-eye-view videos to create reactive driving simulations from a single image.
Nov 2026 - 3AI models can forecast sales well yet misjudge price changes
Forecast accuracy does not indicate how accurately a model predicts the effect of price changes.
Nov 2026
How fast it is moving
Often studied with
diffusion modelA type of generative model that learns to reverse a gradual noising process to create data.23 togethervision-language-action modelA robot policy model that maps visual observations and language instructions to actions, trained on demonstrations and often used for manipulation tasks.22 togetherflow matchingA generative training method that learns an ordinary differential equation mapping noise to data by matching velocity fields along probability paths.20 togetherWho is working on it
The papers
Most central to this idea first, not most recent.
- Big Techcs.LG
AI models can forecast sales well yet misjudge price changes
Forecast accuracy does not indicate how accurately a model predicts the effect of price changes.
Seoul National University, Microsoft · Nov 2026
- Big Techcs.CV
AI agents benefit from checking both plans and imagined outcomes
Tiresias plans actions by generating candidate trajectories, ranking them, then imagining their visual consequences via a world model.
University of Washington, National University of Singapore · Nov 2026
- Big Techcs.CV
Driving simulators follow planned paths more faithfully with overhead views
BirdDreams jointly generates perspective and bird's-eye-view videos to create reactive driving simulations from a single image.
NVIDIA, KAIST · Nov 2026
- Independentcs.RO
World model simulator works across 22 robot platforms, enables policy learning
PrimeSim turns a pretrained video generator into an action-conditioned, multiview world model that simulates robot manipulation across embodiments at 10.1 FPS.
Nov 2026
- Top Universitycs.RO
Metric depth helps robotic manipulation policies generalize across different robots and settings
Using metric depth from stereo cameras boosts robot manipulation success and generalization from UMI demonstrations.
USC Physical Superintelligence Lab, CMU · Nov 2026
- Chinese Techcs.RO
Robot action checks trade off error detection against pinpointing causes
World models trained on clean transitions detect and localize silent action-interface mismatches that are numerically legal.
Yale University, Ant Group · Nov 2026
- Top Universitycs.CV
Joint video and 3D motion prediction reduces trajectory errors by over half
WorldFlow jointly predicts future video and queried three-dimensional object motion, achieving the best displacement errors among evaluated learning-based methods on three test sets.
RoboScience, National University of Singapore · Oct 2026
- Chinese Techcs.LG
Reconstructing app behavior before coding improves simulated GUI agent training
Separating behavior reconstruction from implementation yields faithful GUI environments from traces, with 91.1% workflow fidelity and 94.0% real-device gain retention.
Nanjing University, Alibaba Token Hub, Alibaba Group · Oct 2026
- Top Universitycs.RO
Unlabelled navigation videos can teach robots how scenes change as they move
OpenNWM learns universal latent actions from action-free video to generalize navigation world models across environments.
CASIA, University of Chinese Academy of Sciences · Nov 2026
- Big Techcs.AI
Predicted GUI screens add little beyond direct action ranking
GUI world models' decision value for action selection is additive beyond direct evaluators, not measured by prediction fidelity.
George Washington University, Amazon Web Services · Oct 2026
- Top Universitycs.AI
Dual Exam benchmarks agents and world models separately, exposing weak coupled performance
Separately evaluating multimodal agents and world models under fixed interventions reveals uneven performance and state preservation failures, with low aggregate scores.
The Hong Kong University of Science and Technology, National University of Singapore · Oct 2026
- Big Techcs.AI
Real-time interactive worlds let AI agents train by doing
A framework adapts Cosmos world foundation models for real-time interactive world simulation in Physical AI.
NVIDIA · Nov 2026
- Chinese Techcs.CV
Training world models for policy improvement beats optimizing pixel accuracy
Training world models to maximize the policy's downstream return improves VLA policies even when next-frame pixel MSE is 17% worse.
Hunyuan, Tencent, Peking University · Oct 2026
- Big Techcs.CV
Unified visual encoder delivers state, language, and reconstruction for world models
ALPS is a visual encoder for world models that jointly learns state information, language alignment, and pixel reconstruction from still images and text.
University of California, Santa Cruz, University of California, Santa Barbara · Oct 2026
- Top Universitycs.CV
Persistent memory and reinforcement learning reduce drift in long driving simulations
WAM-Sim uses persistent hierarchical memory and online flow-matching RL to generate consistent and realistic driving simulations over long horizons.
Fudan University, Shenzhen Yinwang Intelligent Technology Co., Ltd · Nov 2026
- Chinese Techcs.CV
AI game worlds can support multiplayer without additional training
PlayGen2 separates learned 3D world-state evolution from neural rendering to enable real-time, persistent, interactive game worlds.
The Chinese University of Hong Kong, Wellington College · Nov 2026
- Independentcs.RO
Video generators can control robots without producing video, cutting computing costs
Tokenizing robot actions as single video patch tokens lets a pretrained video diffusion model act as a policy without generating videos at inference.
Oct 2026
- Big Techcs.RO
AI driving assistants reduce collisions by anticipating what drivers intend
Extending world models with intent inference improves torque alignment and reduces collisions in shared vehicle control.
Toyota Research Institute, Massachusetts Institute of Technology · Oct 2026
- Top Universitycs.AI
AI agents can learn from imagined outcomes without generating images
Dwell reframes a vision-language model as a recurrent latent transition operator to learn from experience.
HKUST, National University of Singapore · Oct 2026
- Big Techcs.RO
Generated language gives robot policies a working memory
Jointly generating video, action, and language in one model improves robot manipulation and lets generated language serve as working memory.
Brown University, Amazon · Oct 2026
- Research Labcs.LG
World models learn true dynamics with fewer parameters
World2vec learns faithful, compact world models from observations and actions without rewards, matching reward-trained control and identifying dynamical systems.
Helmholtz Munich, Munich Center for Machine Learning (MCML) · Oct 2026
- Academiccs.CV
Robots can answer questions about changing scenes from previously unseen viewpoints
GEMS stores scene changes as temporal deltas in a 3D Gaussian Splatting map and answers spatiotemporal questions via agentic novel-view rendering.
University of Stuttgart · Oct 2026
- Big Techcs.RO
Robots learn from human videos to handle unfamiliar tasks and environments
Representing actions as chains of discrete motion tokens that are reinforced by how well they predict future video frames lets unlabeled human videos train robot manipulation policies.
NVIDIA, KAIST · Oct 2026
- Chinese Techcs.CV
AI model controls characters in unfamiliar game worlds in real time
An agentic game world model that generalizes zero-shot to novel scenes, characters, and motions with real-time interaction.
Tencent, National University of Singapore · Oct 2026
- Big Techcs.CV
Fixed auxiliary cameras make multi-agent world models more consistent
Adding fixed auxiliary camera views to a multi-agent video world model improves consistency between agents and reduces token cost by encoding only changes from a static reference.
Meta AI, University of Oxford · Oct 2026
- Academiccs.CV
System streams infinite 3D worlds that remember and restore user edits
WorldStream combines hierarchical planning and persistent tile records to stream unbounded 3D worlds with interactive editing and deterministic revisit.
University of Science and Technology of China, Joy Future Academy, JD · Oct 2026
- Top Universitycs.RO
Robots Can Revise Visual Plans Instead of Starting Over
Revisable Temporal Planning revises a robot's visual plan after execution feedback by continuing from a saved intermediate generation state.
Beihang University, Peking University · Sept 2026
- Top Universitycs.AI
Cell perturbation models inflate accuracy by ignoring unresponsive genes
Global Pearson correlation inflates perturbation prediction accuracy by up to 13x because most genes do not respond to perturbations.
Shanghai Jiao Tong University · Nov 2026
- Independentcs.RO
Flash decoding speeds visual planning for robots 25x
VFlash speeds up visual planning by predicting entire spatial primitives in one forward pass rather than one token at a time.
Nov 2026
- Academiccs.RO
AI agents plan better by separating subgoals from precise actions
ID-WM decouples reachable state transitions from precise actions to plan long-horizon tasks without task-specific knowledge.
New York University, Meta-FAIR · Nov 2026
- Independentcs.AI
AI agents can explore alternative plans without copying shared environments
Agentic World Modeling enables test-time scaling by simulating actions through read-only environment queries.
Nov 2026
- Chinese Techcs.RO
Scoring imagined futures and actions before execution triples robot success rates
Scoring several imagined robot action plans before execution, by action smoothness, agreement between the action and its own predicted motion, and task progress, picks better plans than executing what the model proposes first.
Huawei Technologies Canada, University of British Columbia · Nov 2026
- Chinese Techcs.RO
AI models can reason better by predicting videos of outcomes
RynnUnify is a 16B unified embodied model that combines understanding with long-horizon visual planning via interleaved video-language reasoning.
DAMO Academy, Alibaba Group, Hupan Lab · Oct 2026
- Chinese Techcs.RO
Future 3D motion prediction boosts robot learning with fewer demonstrations
Augmenting robot action learning with future 3D motion prediction improves manipulation performance and generalization.
The Hong Kong Polytechnic University, Alibaba Group · Oct 2026
- Big Techcs.CL
Dense progress rewards help train agents on longer computer tasks
Latent-world task generation plus dense progress rewards makes long-horizon agent training tractable and improves open models across in-domain and transferred terminal benchmarks.
Adobe Research, University of California, Los Angeles · Oct 2026
- Chinese Techcs.RO
Context scheduling improves long-horizon robot video prediction
Reorganizing inference context by preserving initial anchor and recent blocks improves long-horizon robot video world model prediction and efficiency.
The Hong Kong University of Science and Technology (Guangzhou), North China Electric Power University · Oct 2026
- Big Techcs.CL
Language models predict research outcomes across different training environments
Language models can use real experimental records to predict intervention outcomes across research environments, improving experiment selection and reusing knowledge across tasks.
Amazon, UC Santa Cruz · Oct 2026
- Chinese Techcs.CV
Sparse aerial photos become persistent, agent-editable 3D city models
Sparse aerial observations can be converted into persistent, agent-operable 3D cities with metric geometry, road connectivity, and editable entity identities.
Nanjing University, Shanghai Artificial Intelligence Laboratory · Oct 2026
- Big Techcs.CV
More Egocentric Video Improves Agents but Not Their Object Effects
Scaling ego-centric video to 30,000 hours models agents well but leaves object interaction fidelity far behind, requiring training changes, not just more data.
University of Illinois Urbana-Champaign, Carnegie Mellon University · Oct 2026
- Top Universitycs.CV
Unified world action model jointly learns perception, prediction, and planning
A single model can jointly reconstruct 3D hand and camera motion, predict action-conditioned video futures, and plan goal-directed manipulation trajectories, with unified training improving all three.
HKUST (GZ), Primatix · Oct 2026
- Chinese Techcs.RO
Systematic study reveals what matters for world modeling in robot VLAs
2D semantic representations and decoupled world model integration improve VLA robustness on long-horizon and dynamic tasks.
Chinese Academy of Sciences, University of Chinese Academy of Sciences · Oct 2026
- Big Techcs.LG
Verified forecasts help coding agents choose safer, more effective actions
ANTE trains coding agents to predict action outcomes before executing, improving task success and world model accuracy.
University of Maryland, College Park, AWS AI Labs · Oct 2026
- Chinese Techcs.AI
Large-scale dataset and world-model RL improve embodied navigation in open worlds
Embodied world agents improve open-world navigation-planning via offline pretraining on a 200K-sample dataset and interactive reinforcement-learning post-training inside a video world model.
Tencent Hunyuan · Oct 2026
- Big Techcs.AI
Evolving environment beliefs helps LLM agents adapt without retraining
EvoBelief improves frozen LLM agents by validating, reusing, and revising falsifiable environment rules, including after hidden dynamics changes and during scientific discovery.
Tulane University, Amazon · Oct 2026
- Big Techcs.RO
Autoregressive video pretraining unlocks the value of long context for real-time robot control
Longer visual history improves world-action model control only with autoregressive video pretraining.
NVIDIA, MIT · Oct 2026
- Top Universitycs.RO
Forecasting 3D scene motion improves dexterous robot manipulation
Jointly forecasting 3D point trajectories of scene and hands improves dexterous robotic manipulation.
POSTECH, KAIST · Oct 2026
- Independentcs.AI
Auditable world-model harness achieves perfect ARC-AGI-3 score
Kepler’s auditable executable world models achieved 100.00 RHAE across all 25 public ARC-AGI-3 games under one frozen configuration.
Independent Researcher · Oct 2026
- Big Techcs.CL
Adaptive simulated training makes web agents more resistant to prompt injection
AdvSim2Real co-evolves tasks, attacks, and a web agent in a simulated world, raising task completion under unseen attacks by 33.6%.
Mohamed bin Zayed University of Artificial Intelligence, Amazon · Oct 2026
- Big Techcs.CV
Evolving physics captions improve video models’ physical plausibility
Using a self-evolving language framework improves video world model physical plausibility without extra visual signals.
NVIDIA, University of Oxford · Oct 2026
- Research Labcs.CL
Accurate World Predictions Are Not Required for Agent Training Gains
World model post-training improves agent performance through training effects other than accurate world prediction, as mismatched targets retain task gains despite lower accuracy.
Xi’an Jiaotong University, University of Southern California · Sept 2026
- Chinese Techcs.AI
Frozen LLM agents learn world models via reflective rulebooks
An agent learns explicit world models as rulebooks and code, clearing all ARC-AGI-3 levels with 44% of human actions.
University College London, Huawei Noah's Ark Lab · Oct 2026
- Big Techcs.LG
Persistent evidence helps long-horizon agents recover from earlier mistakes
Persistent belief updates across rollback plus an implicit world model improve failure recovery in long-horizon agents, and distillation cuts teacher cost.
University of Maryland, Google · Oct 2026
- Big Techcs.RO
Flexible block-causal models sustain efficient long-horizon action-conditioned rollouts
A block-causal world-action model enables real-time, stable long-horizon imagination and planning, solving benchmark tasks entirely in imagination.
Center for Robotics and Embodied Intelligence (CREO), New York University, Courant Institute of Mathematical Sciences · Oct 2026
- Top Universitycs.CV
Touch signals improve predictions of how hands manipulate objects
A world model conditioned on tactile signals reduces hand motion underestimation from 23% to 9%.
Yale University, Texas A&M University · Oct 2026
- Top Universitycs.CV
Better video predictions improve robots’ performance on unfamiliar manipulation tasks
Video Prediction Policy 2 achieves strong zero-shot generalization in video prediction and action generation for robot manipulation.
Robotera, Tsinghua University · Oct 2026
- Chinese Techcs.CV
Robotic world models learn by comparing diverse predicted futures
FutureWorlds reduces LPIPS by 14.78%, 20.84%, and 9.12% on three datasets for 32-frame predictions.
HKUST (GZ), CUHK · Oct 2026
- Chinese Techcs.LG
GUI world models fail when hidden state is omitted from predictions
State aliasing in GUI world models is resolved by inferring hidden state from history.
University of Chinese Academy of Sciences, Institute of Automation, Chinese Academy of Sciences · Sept 2026
- Big Techcs.RO
Shared 3D geometry aligns predicted driving scenes and vehicle motion
PhysWAM uses a geometric constraint between depth and ego motion to jointly predict future scenes and actions for autonomous driving.
University of Southern California, Woven by Toyota · Oct 2026
- Big Techcs.CV
Simulator-aligned training makes world models more responsive to actions
CtrlWAM aligns perturbed actions with their visual consequences in a simulator to improve intent-foresight consistency in world action models.
NVIDIA, UC Berkeley · Oct 2026
- Academiccs.RO
Depth supervision boosts RGB and geometric consistency in robot world models
DepthWorld jointly predicts RGB and depth, improving RGB PSNR by 1.48 dB over an RGB-only baseline while providing metric depth.
Czech Technical University in Prague · Oct 2026
- Top Universitycs.CV
Control objectives, not reconstruction quality, should guide representation design in world-action models
ReWAM shapes representations with action objectives, achieving 93.6% success on RoboTwin 2.0 without generative video pre-training.
Huazhong University of Science and Technology, D-Robotics · Oct 2026
- Chinese Techcs.CV
One-step action generation and asynchronous pipeline achieve real-time world action models
RealtimeWAM enables near-lossless real-time action generation with 25x speedup via one-step denoising and asynchronous pipelining.
Nanyang Technological University, Beihang University · Oct 2026
- Chinese Techcs.RO
Counterfactual post-training improves robot world model's action following and physical plausibility
A robot world model using offline geometric calibration and counterfactual post-training improves action following and cuts human-assessed interaction defects from 48.12% to 6.25%.
Institute of Automation, Chinese Academy of Sciences, Alibaba Group · Oct 2026
- Top University
Action-discriminative world models improve counterfactual planning for robot control
World models for planning should preserve action-dependent differences for counterfactual selection, not just factual prediction accuracy.
Nanjing University · Sept 2026
- Chinese Techcs.CV
Synthetic GUI trajectories train agents without running target software
Synthesizing GUI interaction trajectories with image generators improves GUI agent performance on real desktop and scientific tasks.
Hunyuan AI Data Team · Oct 2026
- Academiccs.RO
Predictive visual models improve action generation for generalist robot manipulation
InternW0-Δ jointly models visual dynamics and action generation for robot manipulation, outperforming prior methods across benchmarks.
Shanghai AI Laboratory · Sept 2026
- Top Universitycs.CV
Self-supervised tri-modal model perceives and forecasts any road obstacle without labels
TriO is a tri-modal unsupervised world model that predicts 4D occupancy, obstacle segmentation, flow, and LiDAR, achieving state-of-the-art on multiple 3D/4D tasks and zero-shot road obstacle segmentation.
Waabi, University of Toronto · Oct 2026
- Academiccs.CL
Editing agent reasoning history boosts long-horizon task performance
Editing noisy agent reasoning and actions, rather than predicting tool outputs, improves long-horizon agent performance by 3.2-6.7 points.
Gaoling School of Artificial Intelligence, Renmin University of China · Sept 2026
- Big Techcs.MA
Counterfactual world models improve fully decentralized multi-agent learning
Agents learn more effectively by prospectively comparing consequences of candidate actions using counterfactual world models.
Fordham University, City University of Hong Kong · Oct 2026
- Big Techcs.LG
Predicting environment observations during fine-tuning improves later agent exploration
Supervising agent language models to predict observation tokens during SFT, not just actions, improves downstream RL exploration and pass@k.
University of Maryland, AWS AI Labs · Sept 2026
- Chinese Techcs.CV
Executable code gives generative worlds persistent rules and evolving state
CoDeR combines explicit code-based world rules with diffusion video generation to enable open-ended world simulation.
USTC, TongYi Lab · Sept 2026
- Research Labcs.CV
Adding Depth Helps Video World Models Control Robots More Reliably
SA-WAM integrates depth into world action models via nonlinear encoding, improving robot policy performance on benchmarks and real-world tasks.
Inria, École Normale Supérieure · Sept 2026
- Academiccs.RO
Robots can borrow a video model's foresight and act 21 times faster
Compressing a video world model's internal features and distilling them into an action model lets a robot act about 21 times faster at run time without the video model.
Harbin Institute of Technology, Shenzhen · Nov 2026
- Big Techcs.CL
Language models learn to propose improvements for other language models via RL with a learned world model
LM2LM uses reinforcement learning to train LLMs to generate effective proposals for improving other language models.
The Pennsylvania State University, UC Santa Cruz · Oct 2026
- Chinese Techcs.CV
AI video generators can follow new commands while remembering earlier actions
Hy-Nomas is a video world model that generates interactive visual worlds from free-form text and camera instructions across multiple turns.
Tencent Hy Visual Generation Team · Oct 2026
- Independentcs.SE
Models struggle to predict software behavior after stateful interventions
Current models predict stateful service changes poorly without correct intermediate feedback, with rollout errors compounding across later calls.
Independent Researcher · Sept 2026
- Chinese Techcs.LG
Predicting tool outputs speeds reinforcement learning without corrupting rollouts
ObsSpec reduces agent latency by up to 14.2% in agentic reinforcement learning by speculating tool outputs using a co-trained world model.
UC Santa Cruz, ByteDance Inc. · Oct 2026
- Top Universitycs.LG
Aiming at observed intermediate targets beats final-goal scoring in frozen world model planning
Aiming at an intermediate observed target instead of the final goal lets a frozen world model reach long-range goals that final-goal scoring misses.
Tsinghua University, Manifold AI · Oct 2026
- Chinese Techcs.CV
A method that generates consistent video observations across multiple vehicles in a shared driving scene
CoDrive jointly generates world-consistent multi-vehicle driving videos with precise camera trajectory control.
Tsinghua University, Tencent Hunyuan · Oct 2026
- Chinese Techcs.CV
Tracking world states improves coherence in generated video stories
StoryEngine uses a state-grounded agentic framework to produce coherent and consistent long-form video stories.
Tencent, National University of Singapore · Sept 2026
- Big Techcs.AIcode
Structured reasoning framework improves LLM game-playing efficiency and payoff
Structuring LLM strategic reasoning as anchor, adapt, recalibrate improves payoff and cuts token use in imperfect-information games.
The Hong Kong University of Science and Technology (Guangzhou), Johns Hopkins University · Sept 2026
- Big Techcs.RO
Rolling predictions make robot replanning 4.5 times faster
Rolling-WAM distributes video-action denoising across replanning cycles to achieve 4.5x faster replanning without sacrificing manipulation performance.
University of Southern California, Brown University · Sept 2026
- Top University
Dynamics-aware distillation preserves motion in four-step video world models
DyMD improves few-step video generation by preserving interaction dynamics via distribution matching distillation.
Beihang University, JD Future Academy · Sept 2026
- Top Universitycs.ROcode
One video world model transfers physical dynamics across robot bodies
A single video model trained on diverse human and robot data can simulate physics for unseen embodiments zero-shot.
Princeton University · Aug 2026
- Big Techcs.CV
Shared visual transition training improves multimodal LLMs across diverse tasks
Visual transition reasoning can serve as a shared training primitive for multimodal LLMs, improving performance across diverse tasks.
Northwestern University, Carnegie Mellon University · Oct 2026
- Research Labcs.RO
New memory architecture lets legged robots remember maze layouts while exploring
A spatially indexed memory lets legged robots explore mazes end-to-end and remember the layout three times better.
Technical University of Darmstadt, Robotics Institute Germany (RIG) · Oct 2026
- Top Universitycs.AI
Latent world models for robotics scale predictably with compute
Latent robotic world model quality and downstream planning success follow a second-order power law in training compute across 12 embodiments.
FAIR at Meta, Chandar Research Lab · Oct 2026
- Big Techcs.RO
One Model Predicts Robot Futures and Chooses Actions
SUAVE uses a masked diffusion transformer with discrete tokens to unify video, actions, and language into one model.
Columbia University, Toyota Research Institute · Oct 2026
- Top Universitycs.CV
Physical measurements expose persistent flaws in video world models
A 40-task measurement-based benchmark for video world models finds persistent physical inconsistencies, with the best model scoring 57.76 out of 100.
Navers Lab, Einsia.AI · Oct 2026
- Big Techcs.CV
Video models reason better when trained to anticipate future states
ProAR makes autoregressive video reasoning more goal-directed by predicting outcomes and aligning current representations with future transitions, improving accuracy and training efficiency.
The Hong Kong Polytechnic University, University of California, Davis · Oct 2026
- Top Universitycs.RO
Robots can anticipate physical changes without generating videos of the future
PDRVLA learns compact physical tokens from vision-language features to condition robot actions on future scene dynamics without online video generation.
Peking University, JD.com · Oct 2026
- Chinese Techcs.CV
BEV maps enable human-friendly control for embodied navigation video generation
Map2Vid reformulates navigation video generation as a BEV-map-to-video synthesis problem for intuitive control.
East China Normal University, King Abdullah University of Science and Technology (KAUST) · Oct 2026
- Chinese Techcs.CV
World coordinates replace learned features for game model control
ActionRoPE represents action-driven camera displacement as world-coordinate rotary positions, enabling spatially consistent control in planar-camera game world models.
Tencent, National University of Singapore · Oct 2026
- Top Universitycs.RO
Federated robot learning preserves local expertise while cutting communication costs
A federated method assembling local LoRA adapters as server MoE experts outperforms centralized PEFT by 12.23% with 86.81% less communication.
Nanjing University, Peking University · Sept 2026
- Independentcs.AI
Composed service environments improve agents across diverse tool-use benchmarks
CompoWorld generates cross-service tasks from reusable services to train agents that outperform frontier models.
Sept 2026
- Top Universitycs.RO
Visual action rehearsal helps language models control robot manipulation
A visual action workspace lets general-purpose VLMs rehearse, revise, and correct robot actions, achieving 75.6% average success on LIBERO-Pro.
HKUST(GZ), CUHK · Sept 2026
- Top Universitycs.RO
Touch-directed curiosity helps robots discover useful manipulation skills
Tactile-driven curiosity lets robots learn manipulation and grasp policies without task rewards or demonstrations, and improves post-training of VLA models.
ETH Zürich, University of California, Berkeley · Oct 2026
- Chinese Techcs.CV
Code simulations teach video generators realistic physics with little data
Executable code as privileged context in on-policy self-distillation dramatically improves physical plausibility in video generation.
HKUST, Alibaba Group · Nov 2026
- Chinese Techcs.CV
Video generators follow user-defined rules better when separate software controls object behavior
BoxWorld separates interaction reasoning from generative rendering to create real-time interactive video worlds with user-defined behaviors.
University of British Columbia, Vector Institute for AI · Oct 2026
- Big Techcs.CV
Preserving camera-motion information helps video generators maintain more consistent geometry
CausalAlign improves ego-motion consistency in video generation by aligning representations with a 3D foundation model.
Peking University, Beijing Institute for General Artificial Intelligence · Oct 2026
- Chinese Techcs.AI
Solved mathematical mechanisms can generate verifiable training worlds for AI agents
Generating agentic RL training environments from pre-solved mathematical mechanisms yields cheap, verifiable, stateful tasks that transfer to unseen and external benchmarks.
Georgia Institute of Technology, Alibaba Token Foundry, Alibaba Group · Sept 2026
- Chinese Techcs.AI
Explicit belief states help agents stay coherent over long tasks
Explicit belief states that track world state and unresolved task requirements, validated for consistency and monitored for progress, improve long-horizon LLM agent performance.
Nankai University, Alibaba Group · Oct 2026
- Top Universitycs.CV
Predicting velocity fields helps video models generate more realistic fluids
FluidGen generates physically plausible fluid videos by jointly predicting a 3D velocity field alongside RGB.
Stanford University · Oct 2026
- Chinese Techcs.CV
World model forecasts future 3D geometry directly without recursive rollouts
GeoWM directly predicts future 3D geometry at requested horizons, improving accuracy and cutting long-horizon inference time by avoiding recursive rollouts.
Huawei Noah's Ark Lab · Oct 2026
- Top Universitycs.RO
Coding agents synthesize robot planners that generalize to unseen instances
Coding agents outperform hand-engineered planners on generalized task and motion planning problems by synthesizing reusable programs.
Fondazione Bruno Kessler, Carnegie Mellon University · Sept 2026
- Independentcs.AI
Scene-grounded decoding keeps vision-language plans executable and visually supported
Scene-grounded constrained decoding with hard masks and HMM lookahead improves vision-language embodied plan grounding and safety.
Sept 2026
- Big Techcs.CV
Persistent memory keeps generated 4D worlds consistent across camera paths
Demiurge constructs navigable 4D worlds from a single video by autoregressively rerendering novel views and merging them into a dynamic 4D point-cloud memory.
USTC, CASIA · Oct 2026
- Chinese Techcs.RO
Robot-relative 3D features improve pretrained manipulation policies across diverse tasks
Spatial Grafting binds frozen 3D reconstruction features to metric robot-relative geometry to improve pretrained robot manipulation policies.
University of Toronto, Huawei Noah’s Ark Lab · Sept 2026
- Big Techcs.RO
Active view selection enables event-referential grasping of occluded targets.
A zero-shot grasping system uses event history to identify and grasp objects referenced by past interactions, even when occluded.
Seoul National University, NVIDIA · Oct 2026
- Chinese Techcs.CV
Latent trajectory guidance improves video generation reasoning
VR-JEPA uses latent trajectory prediction to guide video generation for improved visual reasoning.
Sun Yat-sen University, Shenzhen Loop Area Institute · Oct 2026
- Chinese Techcs.CV
Language enables precise character and camera control in video worlds
Language instructions can precisely control video generation by reusing the model's existing semantics with minimal adaptation.
Tencent, National University of Singapore · Sept 2026
- Big Techcs.AI
Explicit predictive states boost physical plausibility in video world models
Physical Registry adds explicit predictive states to video DiTs, improving physical plausibility with minimal parameters.
Yonsei University, Microsoft Research Asia · Oct 2026
- Top Universitycs.LG
Reinforcement learning can stably trap itself in low-return policies via representation superposition
Self-confirming superposition traps allow optimal representation fitting to stabilize a lower-return policy in reinforcement learning.
University of Cambridge, University of Sydney · Oct 2026
Concepts are extracted from each paper and reused across the corpus, so this page grows on its own as the desk reads.