Long context windows do not ensure reliable sustained execution
Willette, Puvvada and Ginsburg introduce Long-Transduction, a diagnostic for whether models can repeatedly read state, transform it and emit correctly aligned outputs over long generations. Their experiments show that advertised context capacity does not imply dependable execution: accuracy fell substantially as context grew from 4K to 128K tokens, even though the underlying operations remained controlled.
