, which process both images and text, generate answers one word at a time. This is slow, especially when the response is long. A common fix uses a small, fast model to guess many words at once, which a larger model then checks in parallel. But the fast model often guesses poorly for words that depend heavily on seeing an image.
MMFlash first measures how much each word relies on visual input by comparing the model's predictions with and without the image. It then gives extra training weight to words with high visual dependence that the fast model predicts badly. For long videos, it also uses a pattern that skips redundant visual tokens, focusing on critical ones and nearby text.
On tests across seven image and three video benchmarks, MMFlash achieved decoding speedups up to 3.58 times faster than standard generation. It outperformed other methods by up to 195.4% over one baseline and 17.1% over another, all while producing identical final answers.
