Video world models are supposed to predict what happens next from a single starting image. But do they truly understand cause and effect? When a tiny change, like moving a box a few millimeters, completely flips the future (falling vs. staying), a real world model must change its prediction. Current models mostly don't.
The authors built FlipTest, a set of 1,680 starting frames from 10 simulated and 15 real tasks. Each frame has a near-identical partner where a small shift crosses a physical boundary (e.g., a table edge). They tested 11 video world models to see if predictions flip only when the future actually changes.
The best model scored only 18.3% accuracy, below the 25% of random guessing. Models flipped just as often for non‑decisive changes as for critical ones. This matters because these models are used for robot planning and simulation, yet they miss the causal state that controls what happens next.