Safety instruction influence controlled via eigenvalue modulation in transformers
The authors derive a Contrastive Safety Loss with a suppression weight that modulates the dominant eigenvalue of a safety instruction's operator in transformer models. They demonstrate that varying this weight produces a continuous relationship between attack success rate and over-refusal rate, and that appropriate weight values yield Pareto-improved safety instructions across multiple optimization methods.
