Safe agent self-modification requires verifiable, expressive recovery mechanisms
The authors evaluated model-generated self-modifications on 600 unseen, one-shot tasks and found 197 mutations that improved capability but failed recoverability checks. Controlled interventions showed that most failures could be repaired only by combining precise state references with a more expressive language for specifying recovery actions.
