In self-supervised , critics often fail to measure distances in units of time. ChronoSRL addresses this by training the distance between state-action and goal embeddings to match the actual time taken to reach the goal. Goals not reached or from other trajectories are pushed at least one discount horizon away, giving the critic an explicit temporal geometry.
Instead of using temporal distance directly for the policy, ChronoSRL builds on survival RL to predict the full distribution of goal-reaching times and time spent near the goal. This trains the policy to favor actions that reach the goal sooner and more reliably, and keep the agent near the goal. ChronoSRL learns faster and achieves higher performance than baselines on seven benchmarks, even with smaller networks. It also succeeds on new sim-to-real robot tasks where other methods fail.