When a robot acts, an unseen disturbance, such as a gust or current, can change the result. A counterfactual asks what would have happened under a different action but the same disturbance. A model trained on ordinary outcomes cannot recover that event-specific answer from those outcomes alone.
The method takes the gap between the observed result and the model’s prediction for the action taken, then adds that gap to its prediction for the alternative action. This gap, called a residual, captures the disturbance in that particular event. The method works when action and disturbance affect the system separately and smoothly, and can fail at abrupt contacts or when disturbances amplify commands.
Across rendered environments, counterfactual R-squared, a measure of how well predictions match outcomes, reaches as high as 96 percent. That suggests ordinary predictive models can support better hindsight analysis without extra training, provided the physical assumptions hold.
