The author introduces an Operational Validity Contract specifying a monitor’s target, available information, model and environment identity, timing, intervention unit, comparator, calibration procedure, and costs.
High probe accuracy does not guarantee a usable agent alarm
Across four benchmarks, strong activation-based ranking often failed under locked false-alarm budgets, limited calibration data, or deployment shift.
Chinese Tech
Xueping Gao
Alibaba Cloud Computing
Research Digest··2 min read
Thread:Agent Security & Attacks
Gao evaluates activation monitors as operational alarm policies rather than merely as classifiers, requiring thresholds to be fixed using independent calibration data and assessed at the semantic request or trajectory level.
Why this paper
From Alibaba Cloud Computing · Part of Agent Security & Attacks, now 60 papers
In one line
High-AUROC activation probes do not establish deployable alarm policies without semantic-unit evaluation, independently calibrated thresholds, transport, and acceptable low-false-alarm utility.
What we could check
- ·No code link found
- ·No weights link found
- ·No dataset link found
- ·No compute details found
- ✓Limitations stated by the authors (3 noted)
- ✓Reports numbers on named benchmarks (4 benchmarks)
Observed from the paper text and links we have. Absence here means we did not find it, not that it does not exist.
§