Safety benchmark scores reflect training policy more than model capability

A study with two labeling policies on the same prompts shows that guardrail performance is dominated by which definition of 'unsafe' was used in training.

Industry
Vahid Jebraeeli · Jonathon Romero · Yijin Wang · Adrian Chan · Jianbang Zhang

Lenovo

Research Digest··3 min read
Jebraeeli et al.

' (Policy B).

§

Research Digest

Written by Alwyn Sage, research editor. Plate by Ollie Flash, picture desk.

first published
Meet the newsroomHow we workSubscribe