Self-evolving LLM agents improve by editing a persistent skill document. The standard acceptance gate keeps any edit that raises an aggregate validation score. SAGE replaces that rule with a statistical gate.
Standard gates fail because an edit can raise the average while breaking already-solved items, and because the best score on a finite noisy validation set is optimistically biased. SAGE compares the current and edited skill on identical validation items, exposing regressions, and accepts an edit only when a one-sided paired test shows its wins are reliably larger than its losses. It abstains otherwise.
Across five benchmarks and four backbone LLMs, SAGE lowered the regression rate in 19 of 20 settings and matched the baseline in the remaining one. It achieved the highest final score in all 20 settings, for example raising LiveMath from 34.15 to 48.78. The result is a more conservative, trustworthy gate for self-improving agents.