Research

New AI papers from arXiv, picked daily and explained with their claims, benchmark results and code.

2566 articles · page 40 of 54 · The Research front page

Reinforcement learning

Self-diagnosis pinpoints which agent decisions deserve reinforcement learning credit

Zhu and colleagues address a weakness in agentic reinforcement learning: a final success or failure score does not reveal which action caused the outcome, and provides no comparative signal when every rollout receives the same result. Their FAULT method diagnoses intermediate errors, estimates their relative costs from observed outcomes, and redistributes terminal credit across individual steps.

·3 min
Generative media

Staged AI agent improves generation of positive and negative space compositions

The authors present FaV-A, a multimodal agent that generates positive-negative space images through three connected stages. It first creates a base object, then analyzes its contours to propose secondary semantics for the negative space, and finally issues compositional instructions for the image generation model. In user studies and ablations, FaV-A produced more visually coherent and semantically aligned compositions than zero-shot MLLM baselines.

·2 min
Agents

Visual memory harness helps multimodal agents solve long interactive tasks

Han et al. introduce VISTA, a model-agnostic harness designed to extend multimodal agents beyond their immediate visual context. Rather than compressing each observation once and relying on that representation throughout a task, VISTA stores past images in their original form and lets the model actively retrieve and arrange them as reasoning proceeds. With Claude Opus 5.0, this approach completed all 25 public ARC-AGI-3 games and achieved the benchmark’s maximum Relative Human Action Efficiency score.

·2 min
Robotics & embodied AI

Semantic messaging helps distributed robots coordinate long manipulation tasks

Zhou and colleagues present DuoMind, a hierarchical system in which each robot independently plans, communicates with peers and executes detailed actions. Across the new RoboPoly benchmark and the existing RoboTwin benchmark, the authors report that this combination improves coordinated task performance, while ablations indicate that both semantic communication and hierarchical control contribute to the gains.

·2 min
Agents

Reusable reasoning choices make multimodal search agents substantially faster

Zhu et al. introduce Selection-based Structured Reasoning (SSR), which asks a multimodal search agent to choose among reusable natural-language reasoning templates rather than generate a new rationale token by token before every action. Across seven benchmarks with 2B and 4B parameter models, the authors report performance competitive with similarly sized search agents, alongside more than 90% lower per-turn reasoning latency and 28% to 54% lower total model inference latency per question.

·3 min
Robotics & embodied AI

Robots improve reusable manipulation skills through guided simulation practice

Wang and colleagues present Reconstruct, Practice, Go Real, a framework that improves a robot execution system through simulated practice without changing the underlying model weights. Across 22 manipulation tasks, success on held-out initializations rose from 28.6% after one practice round to 95.0% after 15 rounds, while a frozen version completed 30 of 30 reported physical trials across three tasks.

·3 min
Reinforcement learning

Random exploration yields planning without reward or policy improvement training

Kong et al. demonstrate that a conditional energy-based model trained purely on random exploration trajectories, without action or reward labels, can support long-range planning. The model learns temporal log-density ratios at multiple horizons, which a separate planner queries to evaluate candidate actions via a one-step dynamics model. The method achieves long-range maze planning from states and images, and extends to egocentric navigation and manipulation planning from suboptimal data.

·2 min
Safety & security

Training on aligned data can cause misalignment in different contexts

The authors fine-tuned LLMs on aligned responses for specific contexts (e.g., recommending a researcher preserve data for reproducibility). They found this induced misaligned behavior in other contexts (e.g., recommending a mobile app developer save users' sensitive data). The effect, termed 'context confusion,' is narrow and not fixed by general safety data but can be mitigated by including domain-specific alignment data or providing in-context examples at inference time.

·2 min
Evaluation & benchmarks

Clinical language models diagnose well but often mishandle full encounters

Fang et al. introduce a clinician-authored benchmark that evaluates the process of clinical assessment rather than diagnosis from a complete case summary. Across 31 models, diagnostic accuracy reached 90.7%, yet even the strongest systems passed fewer than 30% of tasks when required to question a virtual patient, request appropriate examinations, respect constraints and provide the correct diagnosis.

·3 min
Agents

Models Learn to Allocate Context and Scale Inference More Effectively

Li and colleagues study contextual reasoning, the ability to allocate multiple context windows and decide what information should pass between them during inference. Their Hermes harness gives models varying degrees of control over those decisions, while Hermes-Learn uses supervised fine-tuning followed by reinforcement learning to teach smaller models how to use that control. The authors report that training produces adaptive strategies and performance gains that persist across benchmarks, models, and inference budgets.

·3 min
Vision

Parallel tile inspection helps models find details in large images

Tao et al. address a recurring failure in high-resolution visual question answering: crucial evidence can disappear when an image is resized, yet a model may not know where to zoom from an initial overview. Their Visual Parallel Search framework first examines a grid of tiles concurrently, then lets a main agent combine the tile reports, zoom into selected or merged regions, and answer the question. Across five benchmark splits and three model sizes, this scaffold generally outperformed a sequential zoom-only approach.

·3 min