The paper identifies five practices developers use when supervising multiple AI : Planning, Isolating, Logging, Observing, and Triaging (PILOT). The authors built a design probe called ParallelPilot that implements these practices through a planning interface, a run-logger, and an ambient dashboard alongside existing coding tools. In a controlled study with 16 developers, those using ParallelPilot completed 63% more coding tickets per session and monitored one additional agent at peak workload, while reducing their own tracking effort and context switching. Fourteen of the 16 participants preferred ParallelPilot over their usual setup, though the tool did not significantly improve perceived control or success in redirecting agents. These results matter because they show that explicit supervision support—rather than just better code generation—can substantially boost developer productivity when running multiple AI agents in parallel.
Interface support helps developers supervise more coding agents in parallel
ParallelPilot combined planning, session logging, and centralized monitoring, increasing throughput in a small study of short coding tasks.
Big Tech
Tao Long · Weili Shi · Hussein Mozannar · Maya Murad · Rafah Hosn
Microsoft Research AI Frontiers · Columbia University
Research Digest··2 min read
In one line
ParallelPilot increased ticket throughput by 63% and allowed developers to supervise one more concurrent AI agent.
Before you read this
Three ideas this paper builds onmulti-agent coordinationThe collaborative operation of multiple AI agents to solve tasks more effectively or with greater capability.91 papers →runtime monitoringAudits an AI agent's live actions, internal states, or effects against constraints or policies to catch errors and attacks.134 papers →coding agentAn AI-powered software system that autonomously writes, modifies, or extends source code based on high-level instructions.167 papers →
Read it as
The authors studied how developers coordinate multiple autonomous coding sessions, then distilled five supervisory practices into the PILOT framework: Planning, Isolating, Logging, Observing, and Triaging.
The authors first conducted a formative study with 14 developers to identify recurring practices for supervising concurrent .
How it works
before and afterThe Daily Edition
The front page in your inbox each weekday morning: the lead, the picks, and why each one earned its place.