MOPD-Router replaces one-teacher-per-prompt assignment with token-level routing across the full teacher pool. It needs neither prompt domain labels nor a separately trained router, and can select and weight teachers through plug-in metrics.
Its ExpertAlign metric favors teachers whose current correction reflects specialization acquired during post-training. Across strong-to-weak and same-size distillation on unlabeled and labeled mixtures, ExpertAlign performed best in all four settings. It improved the overall score by 5.88 points, or 12.3%, over mean aggregation on unlabeled data, and by 3.95 points, or 7.8%, over standard MOPD on labeled data while ignoring the labels.
The result matters because different specialists can contribute at different generation stages. A prompt's nominal domain may not identify the best teacher for every token, particularly for mixed tasks involving reasoning, code, formatting, or instruction following.