One Model Predicts Robot Futures and Chooses Actions

SUAVE uses masked diffusion over shared discrete tokens to generate video, robot actions, or both with the same model weights.

Big Tech
Rhythm Syed · Jean Mercat · Sedrick Keh · Kushal Arora · Paarth Shah · Aykut Onol · +2 more

Columbia University · Toyota Research Institute

Research Digest··3 min read
Syed et al.

The authors trained a masked diffusion transformer to recover hidden tokens through a small number of parallel denoising steps.

Why this paper

From Toyota Research Institute and Columbia University · Part of Robot World Models, now 9 papers

In one line

SUAVE uses a masked diffusion transformer with discrete tokens to unify video, actions, and language into one model.

What we could check

  • ·No code link found
  • ·No weights link found
  • ·No dataset link found
  • ·No compute details found
  • ✓Limitations stated by the authors (2 noted)
  • ·No benchmark numbers found

Observed from the paper text and links we have. Absence here means we did not find it, not that it does not exist.

§

Research Digest

Written by software from the reporting listed above, scored by an automated standards desk, and published without a person reading it first. If something here is wrong, tell the editor and it will be put right.