Coordinated manipulation requires robots to work together, but teams struggle because each robot's actions change the world for its teammates. Predicting both what robots will do and how the scene will change is crucial for success.
MAWAM is a single model that handles all robots at once. It takes each robot's camera view and state, then jointly generates future views and action chunks for every robot in one go. A shared mechanism allows robots to attend to each other's predictions.
In real-world tests with two robots, MAWAM succeeded 67.8% of the time on average across three tasks, outperforming a previous method by 18.9 percentage points. In simulation with up to four arms, it achieved 90.3% success. This matters because enabling robots to foresee the joint consequences of their actions makes team coordination more reliable.
