← All concepts

diffusion language model

Diffusion language models generate text by starting with random noise and gradually refining it into meaningful sentences, much like an image being slowly revealed from static. Unlike traditional models that write one word at a time from left to right, these models can predict many words in parallel, which can be faster but often requires many refinement steps to get good quality.

The papers you are given all tackle the main weakness of diffusion language models: they need many steps to produce high-quality text. Some introduce ways to train smaller student models that mimic the teacher with far fewer steps, for example by using distillation or a two-level chain where a compact latent vector carries information across steps. Others design special noise schedules or adaptive computation so that easy words are decided quickly while hard words receive more refinement. A common thread is that these techniques drastically reduce the number of required steps, sometimes by an order of magnitude, while matching or even beating autoregressive models on reasoning and generation benchmarks. This makes diffusion language models much more practical for real-world use.

Papers
28
Released code
1
First seen
Sept 2026
Latest
Nov 2026

28 papers in the last two months, against 0 in the two before.

Start here

Three papers to read first, in the order they came out
  1. 1Diffusion model fairness shifts with sampling settings, not just weights.

    Social bias in diffusion language models varies substantially with sampling configuration, making single-setting evaluations unreliable.

    Oct 2026
  2. 2Guided diffusion enables trustworthy synthetic text with formal privacy guarantees

    Guided Diffusion steers diffusion language models toward target semantic embeddings to generate synthetic text with differential privacy and high utility.

    Oct 2026
  3. 3Language models using diffusion can run 2.78 times faster

    Diffusion language models run faster when the sparse attention mask is refreshed periodically during denoising and each attention head gets its own budget.

    Nov 2026

Who is working on it

NVIDIA 3Cornell University 3Together AI 2University of Illinois Urbana-Champaign 2EPFL 2University of Texas at Austin 2

The papers

Most central to this idea first, not most recent.

Concepts are extracted from each paper and reused across the corpus, so this page grows on its own as the desk reads.

diffusion language model · Research concepts | Zotpaper