are AI programs that write software. Training them on long tasks like building a whole project is hard because we need ways to check if they've done it correctly. Existing methods often discard many real-world code projects because they can't be easily turned into testable tasks, limiting the variety of training data.
RepoFactory is an automated pipeline that takes real code projects and turns them into tasks where an agent must build the entire project from scratch, guided only by a description. It uses an Environment Evolution Loop that continuously adjusts the task, its tests, and the correct answer to make the task both reliable to check and educationally valuable.
When a starting model was trained on 10,159 tasks from 17 software domains, its average score across five coding benchmarks rose by 8.5 points. The Environment Evolution Loop accounted for 2.1 points of that gain, proving that actively improving task quality boosts training effectiveness.