Autonomous AI systems can run for hundreds of steps without human oversight. Simple stop-rules often halt successful runs or miss failures.
This work introduces LeBet (Learn then Bet), which learns a set of Boolean rules (true/false checks) from data to monitor agents. It treats intervention like a betting game, accumulating evidence until a reliable threshold is reached.
On a coding benchmark, the learned rules saved 34.46% of processing cost while improving output quality to 21.59%. This gives engineers a principled way to build monitors with provable reliability against false alarms.
