AD-E2E-JEPA is an action-conditioned world model that evaluates candidate driving trajectories by predicting their outcomes in a latent embedding space. It is tested through goal-conditioned zero-shot planning, using ground-truth future observations as goals and no trained driving policy.
A SIGReg-regularized projector reduces planning patches by 16 times and embedding dimensionality by 4 times. This yields a reported 100-fold inference speedup, including a 0.8-second, 8-frame rollout over 256 candidates, while retaining planning performance.
On NAVSIMv2, the model scores 67.3 or 72.9 EPDMS with multiplicative safety metrics, depending on candidate vocabulary size. Its pretrained projector also raises downstream imitation-learning performance from 80.2 to 85.4 EPDMS, suggesting that the compressed representation remains useful beyond zero-shot planning.