(LLMs) often make mistakes at each step of reasoning, not just at the final answer. Process reward models (PRMs) check each step for errors, but existing PRMs only look at the local step, ignoring past judgments and future steps, leading to incorrect evaluations.
The Global Perspective Process Reward Model (GPRM) evaluates each step by considering previous step evaluations, the current step, and future steps. It uses four checks: Look-back for consistency, Look-ahead for justification, Self-check for validity, and Problem-alignment.
GPRM improved strong baselines by 7.8 points on PRMBench and 5.4 points on ProcessBench. This shows that global context is crucial for evaluating reasoning steps accurately, which can make LLMs more reliable in complex tasks.
