Language models can outdo text searches at revealing internal signals
De Schamphelaere and colleagues train a language model to generate text that strongly activates a specified internal signal in another model. Their model outperforms searching existing text on several measures, and its examples can be checked directly against the model being interpreted, although that does not guarantee a complete explanation of the signal.
