Research

Digests of notable academic papers, primarily from arXiv

212 articles · page 5 of 5

AI & ML

New benchmark standardizes evaluation of coding agent harnesses

The authors introduce Claw-SWE-Bench, a benchmark and adapter protocol for evaluating OpenClaw-style agent harnesses (claws) on coding tasks. They show that adapter design dramatically affects performance: OpenClaw with a minimal adapter scores only 19.1% Pass@1, while a full adapter achieves 73.4% with the same backbone model. The benchmark also reveals that model choice and harness choice each account for roughly 30 percentage points of variation in performance.

11 June·2 min
Multi-Agent Systems

Decentralized agents with shared context outperform centralized orchestration

The authors propose Decentralized Language Models (DeLM), a multi-agent framework that replaces a central controller with a shared context and task queue, allowing agents to asynchronously claim subtasks and build on verified progress. On SWE-bench Verified, DeLM improved performance by up to 10.5 percentage points and reduced costs by roughly 50%. On LongBench-v2, it achieved the highest average accuracy across four frontier model families.

9 June·2 min
Agent Harnesses

Pruning context to recent tool calls improves agent reliability and efficiency

The authors test four context engineering strategies for GPT-5 agents using Model Context Protocol tools on a 50-task hotel expense benchmark. They find that pruning context to the last five tool call/response pairs and adding automated summarization yields the best results: 91.6% complete itemization, 99.64% amount itemized, with 63% fewer tokens and 60% less runtime than retaining full conversation history.

9 June·2 min
Multi-Agent Systems

Multi-agent orchestration generates 3D scenes from single images

The authors propose SceneConductor, a multi-agent framework that generates complete 3D scenes from a single input image. It decomposes the task into three stages—scene initialization, environment construction, and multi-agent refinement—and introduces a geometry-aware layout predictor trained with sparse point-map priors. The method outperforms prior approaches on geometric accuracy, spatial consistency, and perceptual realism across benchmark datasets.

7 June·2 min
Tools & MCP

VLMs improve spatial reasoning by actively imagining novel views with a world simulator

The authors propose Astra, an agentic spatial reasoning framework that combines two components: a world simulator (Astra-WM) that generates novel-view images from context images and natural-language camera motions, and an RL-trained VLM policy (Astra-VL) that decides when to query the simulator. Trained with view consistency tuning and a two-phase RL curriculum, Astra improves spatial reasoning benchmarks by 9–10 points over direct VLM answering, demonstrating that effective world-model-augmented reasoning requires learning when, where, and how to imagine.

5 June·2 min
Agent Harnesses

Self-supervised method improves agent harnesses using past trajectories

The authors introduce Retrospective Harness Optimization (RHO), a self-supervised method that optimizes an AI agent's harness of skills, tools, and workflows using only past task trajectories. By selecting a diverse coreset of challenging tasks, re-solving them in parallel, and using self-validation to pick the best harness update, the method improves pass rate on SWE-Bench Pro from 59% to 78% in a single optimization round.

4 June·3 min
Multi-Agent Systems

Multi-agent framework coordinates narrative and visual consistency for long-form video

The authors introduce ViMax, an agentic video generation framework that coordinates multiple specialized agents to produce long-form videos with narrative planning and visual consistency. By combining a hierarchical narrative engine with retrieval-augmented generation and dependency-aware visual tracking, ViMax maintains global story coherence and consistent character/environment states across scenes, addressing limitations of existing short-clip methods.

2 June·2 min
Safety & Evals

First measurement study reveals widespread authentication flaws in remote MCP servers

Zhou et al. conducted the first systematic measurement of authentication security in real-world remote Model Context Protocol (MCP) servers, scanning over 7,900 live servers and performing in-depth analysis on 119 OAuth-enabled servers. They found that 40.55% of servers require no authentication, and among authenticated servers, every tested server had at least one authentication flaw, with 96.6% vulnerable to dynamic client registration attacks.

21 May·2 min
Agent Harnesses

Proposing a workflow store to harden AI agents against failure

The authors critique the dominant on-the-fly paradigm for AI agents, which synthesizes plans and executes actions rapidly in response to prompts, arguing it bypasses established software engineering processes like testing and adversarial evaluation. They propose an AI Workflow Store of hardened, reusable workflows to amortize the cost of rigor across users, aiming to improve reliability and security for high-stakes applications.

12 May·3 min
Creative Agents

Unified visual-generation agentic model outperforms larger closed-source models

The authors propose VisionCreator, a native visual-generation agentic model that unifies Understanding, Thinking, Planning, and Creation (UTPC) capabilities. End-to-end trained on a new dataset and optimized via Progressive Specialization Training and Virtual Reinforcement Learning, VisionCreator-8B/32B models outperform larger closed-source models on the new VisGenBench benchmark across multiple dimensions.

3 Mar·2 min