CREDO reserves a pair of output tokens and interprets their relative probability as the model’s confidence. Unlike a confidence numeral sampled as text, this readout is deterministic and can be trained directly with a regression loss while RLVR continues optimizing answer correctness.
It also weights answer-learning rollouts according to the disagreement between confidence and outcome, emphasizing confident mistakes and unexpected successes. The reported experiments on mathematical and code reasoning find the best accuracy and calibration among the evaluated methods, with benefits for abstention and selective prediction, though the provided text gives no numerical results.