The paper introduces EHR-RobustGym, a and training environment for clinical agents that use electronic health records. It consists of 5,486 pairs of clean and noisy questions across six clinical intents, testing robustness to missing records, incorrect values, and unsupported query conditions.
Evaluating 12 , the authors found average task success fell from 62.2% on clean questions to 37.9% on noisy ones. Most models also showed instability: requiring four consecutive correct attempts (pass@4) dropped below 50%. The authors demonstrate that both supervised fine-tuning and in this environment improve performance, and those gains generalize to five external EHR benchmarks.