AI models struggle to track motion and update gameplay decisions
Huo and colleagues evaluated vision-language models, which process images and text, as players in 20 Atari 2600 games. They report recurring failures to infer movement, revise actions from current frames, and use long interaction histories effectively, exposing limitations that static image-understanding tests do not directly measure.
