← All concepts

joint-embedding predictive architecture

Joint-embedding predictive architecture, or JEPA, is a method where a system learns to represent the world by predicting future states in a learned abstract space, rather than generating exact images or videos. This lets the system focus on task-relevant patterns and ignore irrelevant visual details, making it efficient for planning and decision-making in robotics and autonomous driving.

The papers show that JEPA can be made more useful for control by aligning its predictions with the actual dynamics and tasks. They address failures like losing information about unstable motions, generating impossible sub-goals, or mismatching a robot's body. Solutions include reconstructing action sequences from latent states, retrieving sub-goals from real observations, sparsifying representations, and adapting at test time using all deployment data including failures. Across tasks, matching the predictive teacher to the control problem consistently improves success, robustness, and inference speed more than simply scaling up data or compute.

Papers
28
Released code
2
First seen
Sept 2026
Latest
Nov 2026

28 papers in the last two months, against 0 in the two before.

Start here

Three papers to read first, in the order they came out
  1. 1AI models can align language and vision using 42-fold fewer samples

    Joint-Embedding Predictive Architectures with good views provably learn the same representation across modalities up to a rotation.

    Oct 2026
  2. 2Robot policy outperforms larger generative models with a quarter of the parameters

    La-JEPA trains robot policies from scratch in a pretrained JEPA feature space and matches or beats much larger generative-backbone policies with fewer parameters and faster inference.

    Nov 2026
  3. 3Stochastic latent variable improves masked image prediction without hurting representations

    Making the predictor's hidden variable stochastic in Joint-Embedding Predictive Architectures improves representation quality and adds uncertainty estimates and diverse predictions.

    Nov 2026

Who is working on it

New York University 3Brown University 2AMI Labs 2University of Toronto 2University of California, Davis 2NVIDIA 2

The papers

Most central to this idea first, not most recent.

Concepts are extracted from each paper and reused across the corpus, so this page grows on its own as the desk reads.

joint-embedding predictive architecture · Research concepts | Zotpaper