Language models can generate text up to three times faster
Galgani and colleagues attach a small drafting component to language models so they can propose several tokens, the pieces of text models generate, before checking them together. Across the Gemma 4 family, the authors report faster generation on server and mobile hardware, alongside a tuning procedure that keeps the drafter useful when the main model is adapted to specialized tasks.









