Research

Digests of notable academic papers, primarily from arXiv

212 articles · page 1 of 5

AI & ML

Diffusion models generate high-resolution elevation maps from low-resolution inputs guided by optical imagery

The authors propose a guided super-resolution approach for digital surface models (DSMs) using denoising diffusion, improving coarse 5 m DSMs to 0.5 m resolution by leveraging high-resolution optical imagery. Experiments on several Central European cities show the method produces DSMs with crisper building outlines and more detailed roof structures than conventional interpolation or filtering.

13 Sept 2026
AI & ML

Sparse mixture-of-experts models overfit repeated training data faster

Jha et al. trained dense Transformers and mixture-of-experts models under varying data-repetition rates, domain mixtures, expert counts, and expert granularities. They find that MoE models lose performance more rapidly than dense models as examples are reused, with susceptibility tracking total parameter count rather than the number of parameters activated per token. Strong masking-based regularization preserves an MoE advantage beyond 64 repetitions, but does not match training on unique data.

13 Sept 2026
Agent Harnesses

Dual-layer knowledge graph connects fragmented pharmaceutical process-development documents

Amirmoshiri, Sahneh and Jangjou built an agentic platform that transforms heterogeneous Chemistry, Manufacturing and Controls documents into a queryable, provenance-linked knowledge graph. On 505 questions drawn from 38 reports for one Sanofi small-molecule program, the lexical retrieval layer performed strongly on direct questions but weakened on comparative and corpus-wide queries.

12 Sept 2026
Agent Harnesses

Cross-task failure diagnosis makes LLM agent harness training faster

The authors developed Ecdysis, a framework for improving the runtime code and instructions that govern an LLM agent’s execution. Rather than revising a harness after each failed task, it analyzes batches of failures for recurring patterns and uses multiple diagnostic roles to propose refinements. In the reported experiments, this reduced training time by up to 1.84× while increasing reasoning accuracy by 18.56% over existing harness-evolution methods.

12 Sept 2026
Memory & Planning

Kernel-managed memory personalizes multiple AI agents with shorter prompts

Lum and Zhang implemented a shared-memory abstraction in AIOS where agents record structured memories but the system kernel controls how those memories are retrieved and inserted into prompts. Across 1,800 trials with three language models, their approach substantially outperformed unmanaged and standard retrieval-based memory while approaching full-context performance at lower computational cost.

11 Sept 2026
Memory & Planning

Hierarchical memory trees improve long-context reasoning without model training

Zhang et al. introduce ConvMem, a training-free framework that uses prompted language models as query-dependent summarization kernels over segments of long documents. On two synthetic long-context, multi-hop question-answering benchmarks, the authors report better performance than training-free baselines and stronger out-of-distribution behavior than reinforcement-learning-trained memory methods.

11 Sept 2026
Safety & Evals

Security contracts preserve authorization across composable LLM agent systems

Zheng and Yang identify “security-context discontinuity”: failures caused when individually sound agent controls lose or reinterpret security information as actions move between components. They formalize an end-to-end contract system and report that its full configuration blocked harmful effects in 2,560 injected attack instances while completing 700 benign tasks and escalating 200 ambiguous cases.

8 Sept 2026
Memory & Planning

Structured agent memories withstand model upgrades better than compressed notes

Goyal and Ray tested whether four forms of agent memory remained usable after changing the model that writes or reads them. Across 48 synthetic histories, fixed-schema knowledge graphs transferred with almost no accuracy change, whereas compressed notes were strongly coupled to migration direction and partially updated retrieval indexes recovered less than half the benefit of full re-embedding.

8 Sept 2026
Memory & Planning

Streaming video memory works better when internalized as evolving latent tokens

The authors introduce LatentStream, a progressive latent working-memory framework for multimodal LLMs processing streaming video. Instead of storing historical clips in an external memory bank and retrieving them as extra visual context, LatentStream converts retrieved evidence into compact, fixed-length latent memory tokens that evolve over time. Experiments show the method outperforms prior store-and-retrieve approaches on both online and offline video understanding benchmarks.

7 Sept 2026
Agent Harnesses

Personalizing agents through cross-session interaction data boosts task success

Wang et al. propose TAHI (test-time adaptation through human-agent interaction), which leverages a user's cross-session interaction history to update agent context and weights while maintaining an evolving rubric that captures personal evaluation criteria. Applied to writing and visual creation across 30 individuals, the adapted agents outperformed non-adapted baselines on individual tasks, and part of the personalization gains transferred to other users.

7 Sept 2026
Creative Agents

Identity preservation remains a distinct challenge for generative image models

The authors systematically benchmark three approaches to identity preservation in generative image models: encoding identity in the input context, using trainable subject-specific parameters (like LoRA), or maintaining a persistent identity layer. Their results show that persistent identity layers consistently reduce identity degradation across iterative edits, small subject scales, and multi-subject compositions, while preserving image quality and instruction adherence.

7 Sept 2026
Safety & Evals

Causal framework distinguishes deceptive outputs from deceptive mechanisms in language models

The authors introduce a causal taxonomy to separate deceptive behavior from deceptive mechanisms in language models, testing distinctions across controlled guessing-game and stock-trading experiments. They find that deceptive outputs can arise without corresponding deceptive mechanisms, while also providing causal evidence that an agent's knowledge about a recipient's information state directly affects deceptive preference.

7 Sept 2026
AI & ML

Chain-of-thought reasoning traces are legible but not interpretable

The authors operationalize the importance of a chain-of-thought reasoning step as its advantage—the change in expected reward from including that step—estimated via Monte Carlo rollouts. They find that LLM judges asked to identify high-importance steps outperform a prevalence baseline but fall well short of a noise ceiling, and that fine-tuning a step-level critic improves performance for incorrect responses but remains far from ceiling for correct ones.

7 Sept 2026