When learning multiple reasoning skills at once, a single (VLM) can struggle because the skills interfere with each other.
The authors trained separate expert models, one for each reasoning domain. These experts were distilled into a single student using multi-teacher (MOPD), where the student learns by having its own answers scored by the experts.
This two-stage recipe outperformed standard mixed-data training. The final model matched each expert on its specialty and still improved from the reinforcement learning stage. The project releases the complete open-source recipe for building a capable general reasoning VLM.
