RPG is a framework that lets robot systems improve their own performance by practicing in simulation. It starts by identifying relevant manipulation skills from an offline dataset and building practice tasks. During practice, it uses execution feedback and privileged simulator information to diagnose failures, then develops new skills, refines existing ones, and updates the system prompt. All changes are validated across tasks before being retained. The final system is calibrated and deployed on a physical robot. In simulated tests across 22 manipulation tasks, success rates rose from 28.6% after the first practice round to 95.0% after 15 rounds, outperforming baselines like ASPIRE and CaP-Agent0. Physical trials on three tasks achieved 100% success. This is interesting because the system improves without retraining model weights, using only self-generated practice and feedback.
Robots improve reusable manipulation skills through guided simulation practice
RPG diagnoses execution failures, revises symbolic skills and prompts, then validates those changes across tasks before physical deployment.
Big Tech
Yen-Jen Wang · Haozhe Jiang · Shuying Deng · Haoru Xue · Weirui Ye · Rocky Duan · +4 more
UC Berkeley · MIT · Amazon FAR · University of Chicago
Research Digest··3 min read
In one line
RPG improves robot task success from 28.6% to 95% through autonomous practice without updating model weights.
Before you read this
Three ideas this paper builds onrecursive self-improvementAn AI system repeatedly uses its own outputs to enhance its capabilities, creating a feedback loop for autonomous improvement.66 papers →skill evolutionThe process of developing, refining, or optimizing reusable capabilities in LLM agents through learning, adaptation, or experience accumulation.42 papers →privileged informationInformation available only during training that improves performance but is not accessible at inference.85 papers →
Read it as
Wang and colleagues present Reconstruct, Practice, Go Real, a framework that improves a robot execution system through simulated practice without changing the underlying model weights.
RPG begins with an offline dataset of robot demonstrations.
How it works
stage by stageThe Daily Edition
The front page in your inbox each weekday morning: the lead, the picks, and why each one earned its place.