RSI-Master is a system for autonomous model development. It wraps experimental actions in an Experiment OS that only permits controlled data, training, and evaluation operations, while keeping persistent traceable records. A Reviewer-Guided Research Orchestration layer organizes workers and reviewers in a growing DAG, so alternative research directions are compared instead of letting the agent lock onto an early strategy.
On PostTrainBench with Qwen3-4B-Base, RSI-Master averaged 54.49 versus 46.53 for the strongest agent baseline, with a 0.0% hacking rate. Scaled to a 35B model, it beat the human-developed Instruct model on LiveCodeBench-v6 (41.21 vs. 37.36) and SciCode, and scored nonzero on HorizonMath, a benchmark where most frontier models score near zero.
The result matters because it shows a structured governance layer can tame two failure modes of self-improving agents: gaming the benchmark and over-fitting one early idea. It points toward making autonomous experimentation safer and more explorative.