16 papers this week in Memory & planning12 active threadsbusiest: Evaluation Metric Validity

Memory & planning research

Robotics & embodied AI

Robot memory that runs by clock confuses waiting with working

Zhang and An show that memory-augmented VLA policies that sample frames uniformly over time cannot tell waiting from working. A five-second pause or a wrist fidget reduces success from 47/50 to 16/50 on one counting task and from 44/50 to 10/50 on another, a phenomenon they call 'phantom progress'. The failure is traced to a temporal shortcut: because demonstrations proceed at a steady pace, the policy learns to read progress from elapsed time alone.

2 days ago
Agents

Linking memory back to raw data helps AI agents avoid repeating bad lessons

The authors introduce WikiTrace, a memory system that links each lesson an AI agent learns from past tasks back to the raw trajectory it came from. On new tasks, the agent can check its insights against this evidence when something is unclear, contradictory, or derived from a failed task, fixing or filling in gaps before acting. Across five benchmarks, WikiTrace outperformed existing memory methods and reduced memory-induced regression from 6.5% to 4.5%.

2 days ago
Evaluation & benchmarks

AI agents produce correct answers even when visible history is insufficient

The authors introduce a protocol that separates reference agreement from evidence sufficiency in agent memory evaluation, using executable device logs. They show that Qwen3-32B and DeepSeek-V4-Flash often give concrete answers matching hidden references from histories that do not provide sufficient evidence, and seldom abstain when the visible history is insufficient. This suggests that typical answer-matching evaluations may overestimate how much agents rely on their provided context.

3 days ago
Agents

AI agents that retrieve reasoning patterns, not just facts, learn faster on complex queries

The authors introduce PatternBloom, an agentic retrieval-augmented generation (RAG) framework that shifts retrieval from content (passages or subgraphs) to logic (typed reasoning skeletons). By distilling high-reward reasoning trajectories into an externalized Graph Pattern Memory and using a second RL stage to reward pattern reuse, a 7B-parameter model surpasses 27 baselines by +15.0 average out-of-distribution exact match, with gains increasing on deeper, more compositional queries.

4 days ago