When we ask an AI to reason step by step, it shows its work in text we can read, letting us check its thinking. But some new AI designs might skip those readable steps, doing hidden calculations in unreadable internal states. This makes it harder to oversee what the AI is doing.
This paper defines a way to measure how much of that hidden, unreadable thinking a model can do, called NLS depth. It counts the longest chain of operations that never outputs human-readable text. The measure looks only at the architecture and training setup, not at how the model is later prompted or fine-tuned.
The authors found that for most current models, NLS depth is about the same as the number of layers. But proposed architectures like full-bandwidth transformers could have much higher NLS depth. Tracking this number could help forecast how hard a future model will be to supervise.
