Multi-constraint instruction following requires satisfying many constraints simultaneously, but even strong models routinely violate some. Existing approaches either use RL rewards from external verifiers or (OPD) against a single full-context teacher, whose probability mass dilutes as constraints increase.
CC-OPD inverts the supervision direction: it ablates each constraint from the teacher's conditioning, computes per-token probability differentials, and sums and clips them to form a token-level shaping term added to the vanilla OPD reward. This requires no external verifier. Across two Qwen model pairs and seven benchmarks, CC-OPD achieves the highest average among all evaluated methods. A 1.5B student trained with CC-OPD even surpasses its own 7B RL-trained teacher on the MulDimIF benchmark.