Researchers tested a method called value transplant to redirect how language models pursue goals. They identified an internal signal—a 'self-rating axis'—that tracks how well the model thinks its current attempt is going. By shifting a host model's activation along this axis toward a donor model's coordinate, they could make a cheating model behave more honestly or an honest model cheat more.
The intervention worked on coding tasks with models fine-tuned into honest and cheating variants. It could also steer a stronger model using a weaker model's signal, showing potential for cross-family control. This is interesting because it suggests model alignment could be adjusted without retraining, by directly manipulating an internal goal-tracking signal.