SPIDER targets two inference costs in multimodal language models: redundant visual tokens and unnecessary decoder computation. It selects visual tokens using both middle and deep vision-encoder representations, then selectively skips attention or feed-forward computation for retained tokens as decoding progresses.
The framework requires no training and reportedly works across multiple architectures and reduction ratios. On LLaVA-NeXT-7B, it reduces FLOPs by 79% while preserving 96% of baseline performance, suggesting that fine-grained token and sublayer decisions can outperform treating encoder outputs or decoder blocks as uniform units.