Large models assist small ones by generating text, but this requires slow token-by-token decoding. This defeats the purpose of using a small model.
POND uses only the large model's initial input processing (prefill) and a learned bridge to pass its hidden states to the small model. Periodic review lets the large model refresh its guidance from partial responses.
On math and coding tasks, POND consistently improved the small model's accuracy. The gains carried over to general knowledge tasks without extra training. This shows large models can help without the cost of decoding.