HM-Router is a method for jointly selecting a model and harness for each query in agentic systems. It learns separate representations for models and harnesses, sharing information across routes, and uses an interaction term based on CP tensor decomposition to capture compatibility between them. On a benchmark of 293 routes from 12 datasets, HM-Router beat the best learned baseline by 7.3 percentage points in routing accuracy and led at all seven cost budgets. When 90% of routes had their outcomes withheld, allowing unobserved combinations improved normalized accuracy by 15.8 points. The method also generalizes to unseen benchmarks and shows sample efficiency. Existing routers only select models, ignoring that a model's performance depends on its harness. HM-Router's shared representations enable effective routing even when execution coverage is sparse, making joint model–harness routing practical and accurate.
Jointly routing models and harnesses improves agent performance under sparse data
HM-Router uses shared component representations to select compatible model and agent-harness pairs, including combinations absent from its training outcomes.
Big Tech
Hao Mark Chen · Royson Lee · Yasuyuki Okoshi · Dimitris Anastasiou · Wayne Luk · Hongxiang Fan
Imperial College London · Samsung · Institute of Science Tokyo
Research Digest··2 min read
In one line
Jointly routing models and harnesses per query using shared representations improves routing accuracy by 7.3 points over the best learned baseline.
Before you read this
Three ideas this paper builds onmodel routingDirecting each query or subtask to the most suitable model to optimize cost, accuracy, or quality.89 papers →agent harnessA system that structures, verifies, monitors, or controls how an AI agent interacts with external tools, environments, or execution runs.186 papers →agentic evaluationMeasuring AI agents' performance in complex tasks, highlighting failures in planning, monitoring, and real304 papers →
Read it as
Chen et al. treat agent deployment as a joint routing problem: choosing both the language model and the harness that manages tools, observations, and execution.
The authors assembled HM-Router-Bench from 12 public agent benchmarks, covering 293 model-harness routes, 73 models, and 25 harnesses.
How it works
before and afterThe Daily Edition
The front page in your inbox each weekday morning: the lead, the picks, and why each one earned its place.
What it released
Code