CoDrive is a video generation framework that jointly creates multi-view observations for two vehicles in a shared driving scene. It uses interleaved local self-attention within each vehicle's views and global self-attention across vehicles to enforce scene consistency, and injects camera trajectories in a shared world coordinate system via projective relative positional encoding. The model is trained with a five-stage progressive strategy that combines large-scale real-world single-agent data with synthetic cross-agent interaction data. The authors also introduce CoDrive-Bench, a benchmark that evaluates trajectory controllability, scene geometry consistency, and instance-level consistency. Experiments show that CoDrive improves cross-agent consistency and trajectory controllability while maintaining competitive visual quality. This work is interesting because most driving world models are single-vehicle, but real traffic is multi-agent; consistent generation across vehicles is essential for cooperative perception, multi-vehicle planning, and interactive simulation.
A method that generates consistent video observations across multiple vehicles in a shared driving scene
CoDrive jointly generates multi-view videos for multiple agents with precise camera trajectory control and cross-agent consistency.
Chinese Tech
Yu Meng · Baining Zhao · Junta Wu · Tengfei Wang · Rongze Tang · Haiyu Zhang · +7 more
Tsinghua University · Tencent Hunyuan · Zhongguancun Academy
Research Digest··2 min read
In one line
CoDrive jointly generates world-consistent multi-vehicle driving videos with precise camera trajectory control.
Before you read this
Three ideas this paper builds onmulti-agent coordinationThe collaborative operation of multiple AI agents to solve tasks more effectively or with greater capability.91 papers →diffusion modelA type of generative model that learns to reverse a gradual noising process to create data.197 papers →world model for agentsA predictive environment model that agents use to simulate outcomes, enabling planning, reasoning, and long-horizon task execution.115 papers →
Read it as
Meng et al. propose CoDrive, a cross-vehicle video generation framework that produces world-consistent observations for multiple vehicles in the same scene.
The authors designed a generative model that takes as input camera trajectories for multiple vehicles in a common world coordinate system and outputs synchronized multi-view videos for each vehicle.
How it works
before and afterThe Daily Edition
The front page in your inbox each weekday morning: the lead, the picks, and why each one earned its place.