RankEvolve is an auto-research framework that evolves generative ranking models over many iterations. It enforces an Executable Operating Protocol (EOP) as a compiled state machine, and it composes complete black-box coding-agent products, such as Claude Code and Codex, as graph nodes that review and repair each other's work. The framework also includes a knowledge layer that carries findings, including negative results, across iterations.
In a budget-matched evaluation, the heterogeneous composition raised all-oracle execution accuracy from 45.8% (best single product) to 62.5%, a paired gain of +16.7 points (95% CI [6.6, 26.7]), with a 10.4% silent critical-defect rate. Deployed for twelve iterations on the HSTU recommender, it reported NDCG@10 of 0.2192 on MovieLens-20M LARGE (+4.48% over the published anchor) and 0.1948 on BASE (+2.80%). A transfer split on LitGPT replicated the composition effect (+12.5 points, 95% CI [3.0, 22.0]). The result is interesting because it provides a falsifiable account of when runtime-controlled composition of improves execution accuracy in long-horizon ML research.