The authors started with Qwen 3.6 27B, a 27-billion-parameter model that processes images and language.
Simulation training lets a pretrained model control robots on unfamiliar tasks
The authors report that ZAP learns motion control without real robot demonstrations, then transfers to hardware, new manipulation goals and a different robot.
Industry
Benjamin Pikus · Daniel Saunders · Mircea Mironenco · Salman Mohammadi · Mathew Mathew · Sirou Zhu · +8 more
Luma AI
Research Digest··2 min read

Pikus and colleagues trained a pretrained vision-language model to operate a robot using only simulated robot experience.
The Daily Edition
The front page in your inbox each weekday morning: the lead, the picks, and why each one earned its place.