Multi-turn rollout dominates the cost of . Asynchronous execution and elastic GPU resources can accelerate rollout, but adding replicas yields diminishing returns while training GPUs remain idle between updates. The effective use of resources also depends on how the prefill and decode phases of inference are executed, including whether they are colocated or disaggregated and the ratio between them. This interdependency makes resource scaling and PD configuration a joint optimization problem.
PEARL is an asynchronous RL system that coordinates external resource elasticity, temporary reuse of idle training GPUs, and adaptive PD execution. It uses runtime profiles to predict rollout batch completion time and selects the best PD mode and ratio under the current GPU budget. Cost-aware switching and borrowing policies suppress transitions with insufficient benefit. In evaluation, PEARL achieves 2.17-2.79x the throughput of fixed-resource ROLL and up to 26.9% and 36.3% improvements over RLBoost+ for Qwen3-8B and Qwen3-30B-A3B respectively.