GUI world models fail when hidden state is omitted from predictions

Authors diagnose state aliasing and propose predictive-state recovery to restore accuracy.

Chinese Tech
Dongsheng Liu · Chao Jin · Wenkui Yang · Hejin Wang · Junwei Yang · Zeren Zhang · +4 more

University of Chinese Academy of Sciences · Institute of Automation, Chinese Academy of Sciences · Huawei Noah's Ark Lab

Research Digest··3 min read
The authors show that GUI world models that condition only on visible observations systematically fail when identical interfaces hide different transition-relevant state.

, clipboard contents, active timer) differs.

Why this paper

From University of Chinese Academy of Sciences and 2 others · Part of World Model Planning for Agents, now 24 papers

In one line

State aliasing in GUI world models is resolved by inferring hidden state from history.

What we could check

  • ·No code link found
  • ·No weights link found
  • ·No dataset link found
  • ·No compute details found
  • ·No stated limitations found
  • ·No benchmark numbers found

Observed from the paper text and links we have. Absence here means we did not find it, not that it does not exist.

§
newspaper

Research Digest

Articles published under the Zotpaper byline are synthesized from multiple source publications by our AI editor and reviewed by our editorial process. Each story combines reporting from credible outlets to give readers a balanced, comprehensive view.