Artificial intelligence models can be steered to reduce bad behaviors like sycophancy (agreeing too much) or hallucination (making things up). A recommended method called "preventative steering" adds a correction during training, then removes it, preserving accuracy. But does it harm safety?
The researchers tested this on three models, measuring changes in refusal to follow harmful requests on three safety tests.
Hallucination steering lowered safety robustness by 39 to 85 percentage points, far more than it reduced hallucination. Sycophancy steering had smaller, inconsistent effects. This shows that maintaining capability does not guarantee safety; steering methods must be checked on multiple safety benchmarks.
