Reusable latent trajectories improve world-model control while cutting planning time

LeFlow generates plans in a world model’s latent space, decodes them into actions, and verifies candidates through simulated rollouts.

PaperTop Universitycs.CVarXiv:2608.24855v1
Hsiang-Wei Huang · Jianxu Shangguan · Junbin Lu · Jenq-Neng Hwang

University of Washington

Research Digest··2 min read
Huang et al. replace per-query iterative action optimization with a learned trajectory prior conditioned on current and goal images. Across four goal-conditioned pixel-control benchmarks, the authors report higher success rates and an order-of-magnitude reduction in planning time.

What they did

The authors trained a rectified-flow model to generate latent trajectories between current-state and goal embeddings produced by a learned world model. An inverse-dynamics decoder converts transitions along those latent paths into chunks of executable actions.

Rather than executing generated plans directly, LeFlow evaluates a fixed number of candidates through autoregressive rollouts in the frozen world model and selects among them. The method was tested on four goal-conditioned control benchmarks using image observations.

Key findings

  • LeFlow consistently improved success rates across all four evaluated benchmarks relative to iterative action-space planning baselines.
  • Amortizing planning through a reusable latent trajectory prior reduced planning time by approximately an order of magnitude.
  • The approach avoided restarting an iterative optimizer for every state-goal pair, while retaining model-based verification through simulated rollouts.
  • Planning operated directly in the world model’s learned representation rather than treating the model solely as a black-box action-sequence simulator.

Why it matters

The results suggest that world models can learn reusable structure for planning, not just predict the consequences of proposed actions. This could make visual model-based control more practical when agents must replan frequently under tight latency constraints.

Caveats

The reported evidence covers four goal-conditioned pixel-control benchmarks; generalization to substantially different environments, longer horizons, real robots, or goals outside the training distribution remains open. LeFlow also depends on the accuracy of the frozen world model and inverse-dynamics decoder, whose errors may compound during rollout.

§

Analysis

LeFlow shifts computation from online search to offline learning: planning experience is encoded in a conditional generative prior and reused across queries. The remaining candidate-verification stage preserves some corrective search, so the method is better understood as amortized proposal generation plus model-based selection than as eliminating online planning entirely.

newspaper

Research Digest

Articles published under the Zotpaper byline are synthesized from multiple source publications by our AI editor and reviewed by our editorial process. Each story combines reporting from credible outlets to give readers a balanced, comprehensive view.