The authors present SAGE, an agent that generates high-performance kernels for NPU accelerators. It addresses the problem that LLMs, trained on CUDA code, perform poorly on NPUs due to differing architectures and scarce training data. SAGE uses two novel mechanisms: Adoption-Traced Utility Estimation (ATU), which credits experiences based on whether they were actually used in code generation, not just retrieved; and Utility-Gated Consolidation (UGC), which promotes repeatedly useful experiences into a permanent memory. On the NPUKernelBench benchmark, SAGE achieved a 95.5% execution rate compared to 84.1% for the best baseline, and 86.9% of its solved operators outperformed the torch_npu library. These results demonstrate that tracking which knowledge is actually adopted allows the agent to learn and reuse hardware-specific expertise more effectively.
Adoption-aware memory learning boosts LLM agent NPU kernel synthesis
SAGE achieves 95.5% execution rate on NPUKernelBench, outperforming baselines.
Chinese Tech
Longxiao Fan · Tao Zhang · Han Yan · Jiajun Li · Mingcong Song · Guoping Long · +2 more
Fudan University · University of Science and Technology of China · Huawei Technologies Ltd.
Research Digest··2 min read
In one line
SAGE achieves 95.5% execution rate on NPU kernel synthesis by tracking adoption and consolidating reusable rules.
Before you read this
Three ideas this paper builds onagent memoryA repository where an agent stores past interactions and outcomes to inform future decisions.241 papers →credit assignmentDetermining which actions or steps in a sequence contributed to a final outcome, often for reinforcement learning.190 papers →memory consolidationSummarizing or structuring past information to reduce token usage while preserving task accuracy.40 papers →
Read it as
Fan et al. present SAGE, a self-improving agent that uses adoption-aware credit assignment and selective consolidation to synthesize high-performance NPU kernels.
The authors propose SAGE (Self-Adaptive Generation from Experience), a persistent memory-learning agent for synthesizing kernels for Ascend NPUs.
How it works
stage by stageThe Daily Edition
The front page in your inbox each weekday morning: the lead, the picks, and why each one earned its place.