Reinforcement learning strengthens policy invocation for agent safety judgments

RePolicy selects applicable rules from a changing policy library, then uses them to assess complete agent trajectories.

PaperTop Universitycs.AIarXiv:2608.24275v1
Houcheng Jiang · Boxuan Zhang · Qiyong Zhong · Junfeng Fang · Xiang Wang · Xiangnan He

Zhejiang University · Zhongguancun Academy · University of Science and Technology of China · National University of Singapore

Research Digest··2 min read
Jiang et al. train an agent safeguard to identify and invoke the safety policy relevant to a full execution trajectory. Initialized on their PolicyTraj-20K dataset and refined with reinforcement learning, RePolicy showed strong safety detection across six benchmarks and remained robust when policy contexts changed.

What they did

The authors developed RePolicy, a safeguard that receives an agent’s execution trajectory alongside a dynamic library of safety policies. It selects the applicable policy, cites its content in a rationale, and produces a safety judgment grounded in that policy.

Training begins with supervised initialization on PolicyTraj-20K, a dataset of roughly 20,000 policy-and-trajectory examples. The model is then optimized using group relative policy optimization (GRPO), verifiable rewards, and perturbations to the policy context intended to prevent reliance on a fixed library arrangement.

Key findings

  • Across six agent-safety benchmarks, RePolicy achieved strong overall safety-detection performance, according to the authors.
  • The system reliably invoked applicable policies even when the surrounding policy context varied.
  • Reinforcement learning with verifiable rewards supported both the final safety judgment and the intermediate task of selecting the relevant rule.
  • Policy-grounded rationales linked judgments to the invoked policy rather than relying only on an implicit model assessment.

Why it matters

Agent safeguards must evaluate sequences of actions under rules that may differ by application or change over time. RePolicy treats retrieval and application of the correct policy as a learned decision problem, offering a route beyond safeguards trained only on fixed prompts or supervised examples.

Caveats

The supplied abstract does not report benchmark-level scores, baseline comparisons, computational costs, or results from real-world deployment. Robustness across six benchmarks therefore does not establish reliability under arbitrary policies, adversarially written rules, ambiguous policy conflicts, or substantially longer and more complex agent trajectories.

§
newspaper

Research Digest

Articles published under the Zotpaper byline are synthesized from multiple source publications by our AI editor and reviewed by our editorial process. Each story combines reporting from credible outlets to give readers a balanced, comprehensive view.