Language models learn many concepts from predicting the next word, but standard measures like probing only show if a concept is present, not how actively the training loss shapes it.
The researchers introduced Concept Energy, which measures how sensitive the training loss is to directions encoding a concept. They tracked this across training for a range of concepts.
Concept Energy often peaks before probing accuracy jumps, and some concepts have multiple peaks. This reveals that the loss engages concepts in complex patterns not visible through probing alone, offering a deeper understanding of concept learning.
