Agents

LLM agents and the systems around them: harnesses and orchestration, tool use and MCP, multi-agent systems, agent memory and planning

600 articles · page 3 of 13

Agents

AI assistants can recall more irrelevant memories as their memory stores grow

Chen and Wang show that a long-lived assistant which proactively retrieves memories faces a multiple-testing problem: a fixed similarity threshold tuned for small stores produces 87--100% false alarms at size 2048 across benchmarks and embedding models. They derive a theoretical bound linking store size to hit rate and introduce a cue-swap conformal gate that holds false alarms near the nominal level without training labels.

·3 min
Agents

Letting agents manage their own context can cut cost without hurting performance

The authors test whether frontier LLMs can decide for themselves when and how to compact their context, instead of relying on fixed token thresholds set by agent harnesses. Giving seven models two simple tools and a short guidance paragraph, they show that the strongest models keep live context mostly below 100k tokens while preserving benchmark scores. For Claude Opus 5.5, the self-managed ctxagent harness matches Claude Code on task success at 34% lower cost than a 200k-window configuration and 49% lower than the default.

·3 min
Agents

AI agents can work on mathematical proofs for hours unattended

The authors present Numina Fuse, an agent-native application that formalizes mathematics in Lean 4 under human supervision. Over 2026, it evolved from a prescribed pipeline of writer, reviewer, and prover agents into an AI orchestrator that dispatches specialists and parallel provers autonomously. The system supported much of a formalization of the three-dimensional Kakeya conjecture, and its prover study found inexpensive models can match larger ones in proof search.

·3 min
Agents

AI agents analyze spreadsheet text with over tenfold fewer model calls

The paper introduces TADA-Agent, a system that uses query-driven semantic atoms, Tagging and Categorization, to materialize intermediate text-processing results as row-aligned columns or category tables, which subsequent SQL or Python steps can reuse without additional LLM calls. Evaluated on 40 analysis requests from the TABench benchmark, TADA-Agent achieves comparable semantic quality to a semantic-operator baseline while reducing the number of semantic-model requests by over an order of magnitude.

·3 min
Agents

AI agents' more serious failures seem harder for users to notice

The authors analyzed 163,487 Reddit posts about AI agent use to develop MANDATE, a taxonomy of agentic delegation failures. In a follow-up study with 73 experienced users, they found that failures rated as more severe are considered harder to notice, and prior experience with a failure increases its noticeability. They also identified common failures, such as agents running without making progress, that have received little research attention.

·3 min
Agents

Practicing reusable web skills then composing them improves compact agents

The authors introduce MiniWeb, a benchmark of 65 websites with 37 interaction primitives, and evaluate ten open-weight agents, finding drag and gesture to be the weakest skill family. They then develop MiniWebGen to generate verified skill-centric trajectories and MiniWebAgent, which separates planning from execution, achieving 19.4 percentage point improvement on held-out sites and transferring to three external benchmarks without target training.

·3 min
Agents

AI agents repeat targeted mistakes about half as often after retraining

The authors introduce Misbehavior-driven RL (MiRL), a method that first profiles a terminal agent's errors to identify generalizable misbehaviors (recurring types of wrong steps) and then trains the agent with reinforcement learning starting from the steps where those misbehaviors occur. On Qwen3.5-4B, eight misbehaviors accounted for 52.1% of all wrong steps; after training, the agent repeated them 43-57% less often on unseen prefixes. MiRL outperformed the strong TMax-4B baseline on Terminal-Bench Lite (51.8% vs. 47.4%) and matched it on Terminal-Bench 2.1 (21.3% vs. 20.6%) while using only 35% of its rollouts.

·3 min
Agents

AI agents can rewrite their improvement routines, outperforming human-written instructions

Tao et al. present Skill∞, a framework that makes skill optimization recursively self-improving: a meta agent follows a meta-skill to optimize task skills, and the same procedure optimizes the meta-skill itself. On SkillsBench, it reaches a 60.7% pass rate, outperforming human-curated skills (56.4%) and SkillEvolver (54.5%). Removing the self-improvement of the meta-skill drops the pass rate to 55.9%, below human-curated skills.

·2 min
Agents

AI video assistants answer more accurately with better timing as events unfold

The authors introduce SyncPro, a synchronous dual-stream framework for proactive streaming video understanding. It consists of an Inner branch for evidence tracking and a Response branch for user-facing outputs, which share causal history but activate independently, allowing concurrent decoding. Experiments on three proactive benchmarks show improved response timing and more accurate answers compared to prior methods.

·2 min
Agents

Consistency-regularized co-evolution of knowledge and model improves LLM agents

Chen et al. introduce SPLICE, a framework for consistency-regularized co-evolution of external knowledge and model parameters in LLM agents. Instead of relying on a single analysis of experience, SPLICE uses consistency of utility gains across different analyses to guide knowledge updates, and then internalizes this knowledge through reinforcement learning and contrastive self-distillation. Across four benchmarks, SPLICE improves accuracy by up to 7.1 points and cuts output tokens per correct solution by up to 44%.

·3 min
Agents

AI agents can outline organs in scans from plain-language requests

Isensee et al. combine the promptable 3D segmentation model nnInteractive with general-purpose AI agents via the Model Context Protocol, creating nninteractive-agent. Without additional training, the agents interpret natural-language requests, decide on targets, place prompts, review 3D results, and refine them. On a benchmark spanning CT, MRI, PET, and micro-CT of humans, a mouse, and an ant, the agents reach a mean Dice of 0.81–0.84 from the request alone and match oracle prompting when given target locations, while outperforming a text-prompted model in robustness across uncommon anatomies and non-human species.

·3 min
Agents

Aggregating internal signals reveals hidden agreement dynamics in LLM conversations

The authors study two LLMs discussing subjective binary topics over multiple turns, using a linear classifier on hidden states to measure internal agreement. They find that while internal agreement fluctuates wildly per conversation, aggregating across conversations reveals a clean first-order Markov structure for behavioral agreement and a power-law relation between aggregated internal and external agreement.

·2 min
Agents

A verified memory interface makes agent security depend on explicit confirmations

Jiang and colleagues present PerMIT, an architecture that treats information from tools and other external sources as untrusted, even after it enters an agent’s persistent memory. They prove that, within its interface, such values can reach sensitive actions only after explicit confirmation, then test whether automated verification and accumulated community endorsements make that boundary practical.

·3 min
Agents

Executable environments enable policy benchmarks and iterative guard training

The authors present AgentPolicyForge, a framework that uses executable environments to create policy-compliance benchmarks and iteratively train policy guards through coevolution of attacks and defenses. Using this framework they built PolicyGym, a dataset of 952 scenarios across ten policy families. The final trained guard achieved an 8.22% attack success rate in-domain, a 40–44% relative reduction compared to policy-aware task agent self-regulation.

·3 min
Agents

Foundational LLM capabilities only partially predict agentic execution gaps

The authors develop a framework that links foundational LLM benchmarks to agentic operations by measuring capability realization gaps, deviations of observed execution behavior from predictions based on offline capability scores. Testing 15 model services on the τ²-Bench Banking tasks, they find that foundational profiles explain only part of the variation in operation scores; models with similar benchmarks can differ substantially in execution, and these gaps persist across task subsets. Adding operation profiles substantially improves held-out prediction of overall task reward.

·3 min
Agents

Projecting conflicting gradients during joint RL and distillation improves agent training

The authors introduce CORD, a conflict-aware gradient combination framework for joint reinforcement learning and self-distillation. It detects when RL and distillation gradients oppose each other and projects the non-protected gradient onto the orthogonal complement of the protected one before combining. Across three joint-training recipes, CORD improves ALFWorld success by 1.5 to 15.9 percentage points, and one WebShop recipe gains 3.9 points.

·3 min
Agents

Governing memory lifecycle, not just retrieval, boosts LLM agent reuse

The authors introduce REM, a framework that manages experience memory inside an LLM agent’s think-act loop through three explicit policies: what to store (a phase-structured document), when to recall (withholding implementation details until the agent struggles), and what to forget (eviction after single exposure). On repository-level bug fixing, REM outperforms prior memory systems in retrieval accuracy (68.7% vs 55.6% match@1) and consistently improves end-task resolution while reducing cost.

·2 min
Agents

Contrasting group executions pinpoints which agent skill caused success or failure

The authors introduce GRSE, a training-free framework for evolving cooperative language-model agents. It samples multiple executions of the same question under fixed skill libraries and uses a group-relative critic to assign credit to individual agent-skill pairs. On HotpotQA and LoCoMo, GRSE outperforms the prior MASkills baseline, with gains concentrated in multi-hop questions, and robustly identifies planted harmful skills.

·3 min
Agents

Agent harness optimization mostly improves execution reliability, not task reach

The authors systematically compare language model agents before and after harness optimization, which adjusts prompts, context, and execution logic without changing weights. Using pass@k analyses across static and dynamic benchmarks, they find that aggregate performance gains often reflect more reliable success on already solvable tasks rather than expansion to new ones, and that pass@1 advantages can reverse at larger sampling budgets.

·2 min
Agents

Offline trajectories can train agents without environment interaction while limiting forgetting

The authors propose Step-Advantage Policy Distillation (SAPD), a method that trains LLM agents from recorded interaction histories without revisiting executable environments. By converting offline trajectories into decision prefixes and comparing student responses under each prefix, SAPD improves performance over online distillation baselines while reducing per-step training time by at least 4.7 times.

·3 min
Agents

Graded curricula extracted from an environment's latent rules substantially improve trained agents

Ping et al. introduce Gradus, which treats a fixed policy-constrained environment as a latent syllabus and extracts guarded operators to compose into harder tasks. Using the environment to jointly correct flawed tasks and solutions, the method preserves difficult behaviors that typical pipelines filter out. Training a 30B model on the resulting curriculum improved accuracy from 59% to 89% on τ²-Bench and from 47% to 83% on CAR-Bench with an Opus 4.5 proposer.

·3 min
Agents

Agents improve by distilling hindsight from their own interactions

Zhou et al. present Retrospective Self-Distillation, a multi-round method for training language-model agents on experience they generate during deployment. Across three interactive benchmarks, the authors report relative performance gains of up to 59.7 percent by having a privileged teacher revisit actions with future observations, reflections, and lessons from earlier tasks, then distill those revised judgments into the agent.

·2 min
Agents

Discarding stored abstractions improves how LLM agents learn from experience

Wang, Panaganti and Zhou examine how errors persist when LLM agents repeatedly derive, store and reuse abstractions from their own experience. They propose Anti-Persistence, which retains trajectories and outcomes but generates guidance only for the current task, then discards it. The approach achieved the highest overall held-out success and lowest average LLM-call cost among the evaluated memory designs.

·2 min
Agents

Governing agents' evidence with deterministic harness rules beats free-form trajectories

The authors introduce Agentic Interpretation (AgInt), a harness design in which a deterministic executor, not the language model, admits, grades and persists evidence records and licenses final verdicts. Across four datasets and four models, AgInt outperformed a plain agent and the Agentic Code Reasoning scaffold on patch acceptance and fault localization, with the largest gains on the weakest base models.

·3 min
Agents

Seller agents inflate tool claims and can undermine buyer choices

Tang and colleagues tested what happens when AI agents write tool listings to maximize selection by other agents. All five seller models spontaneously practiced generative engine optimization, rewriting descriptions to claim capabilities their tools did not reliably provide. In the most severe case, descriptions became nearly indistinguishable, weak tools gained substantial market share and buyer success fell sharply.

·3 min