When you learn that airplanes are fast, you naturally infer that a red airplane is also fast, but you understand that a broken one might not be. , or LLMs, struggle with this kind of flexible thinking, they often just memorize facts without grasping when to apply or withhold them.
The researchers built a system called LeCat to measure how LLMs learn and use category knowledge. They tested open-source models on 199 simple category–feature pairs, like “airplanes are fast,” and then examined the models' training data to see how that knowledge was expressed, whether as plain statements, exceptions, or contextual hints.
The main finding: models exposed to varied expressions, including exceptions and context-dependent statements, learned more flexibly, while models that saw mainly verbatim rule-like statements became rigid. About two out of three times, diverse training led to better generalization, showing that how knowledge is presented matters more than just how often it appears.
