
Speculative decoding speeds up vision models by 3.58 times with visual-token weighting
Feng et al. introduce a metric of token-level visual dependence and discover that highly visual tokens are rejected much more often in speculative decoding (46% acceptance in the lowest quartile drops to 22% in the highest). They propose MMFlash, which reweights the draft training loss to prioritize these tokens and uses sparse attention for long videos. MMFlash achieves up to 3.58× lossless speedup on multimodal benchmarks, outperforming previous methods.














































