← All concepts

delta rule

Papers
3
Released code
0
First seen
Oct 2026
Latest
Nov 2026

3 papers in the last two months, against 0 in the two before.

Start here

The paper to read first
  1. 1Backward pass for long-context AI models runs up to 1.8 times faster

    ReWY reduces delta-rule attention's backward local matrix products from seven to three, speeding complete backward passes 1.15 to 1.81 times on NVIDIA GPUs.

    Nov 2026

The papers

Most central to this idea first, not most recent.

Concepts are extracted from each paper and reused across the corpus, so this page grows on its own as the desk reads.

delta rule · Research concepts | Zotpaper