SCLATE is an execution substrate that addresses the challenge of evaluating and training continual-learning agents, which operate over long multi-session horizons with events like session stops, crons, and . Existing benchmarks and frameworks only schedule their own events, forcing custom loops for each agent-benchmark pair. SCLATE provides an open event scheduler where both benchmarks and unmodified agents register events via adapters, running them on a hybrid simulated clock that compresses month-long scenarios into hours. It also records every model call's tokens and log probabilities through an in-container proxy, enabling post-training.
The authors ported seven benchmarks (e.g., MetaClaw, SWE-bench Verified) to SCLATE and compared ten harness and memory configurations (including Claude Code, Hermes, Mem0) on ten models. Key findings: an added memory system does not reliably beat the harness's native memory, and models vary widely in how they use the same harness and memory. They then post-trained Qwen3.5-4B using SCLATE, achieving 6.8x fewer file lines read, a 16.7-point higher SWE-bench Verified pass rate, richer memory records, and up to 11.8 points higher MetaClaw accuracy. This work enables standardized, reproducible evaluation and training for continual-learning agents.