AI models can reuse layers while retaining image and text abilities
The authors introduce recursive transformer backbones for CLIP where a small set of blocks is applied multiple times, reducing distinct parameters while keeping computational depth constant. They show that such recursive models can be effectively trained via distillation from a conventional CLIP teacher, retaining much of its transferable ability on zero-shot classification, cross-modal retrieval, few-shot learning, and visual grounding.
