The author attached semantic rules, including typing, scope, and declaration effects, to context-free grammars and evaluated them during Earley parsing, an incremental parsing method.
Semantic constraints can prune invalid code during language model decoding
A declarative decoder detected type, scope, and declaration errors that syntax-only constraints could not catch.
Academic
Paul Kronlund-Drouault
ENS de Lyon · Unsuspicious Industries · Université de Lille
Research Digest··2 min read
Kronlund-Drouault introduces semantic grammar specifications, which add contextual program constraints to grammar-guided language model decoding.
Why this paper
From ENS de Lyon and 2 others
In one line
Semantic prefix oracles enforce typing and scope constraints during LLM decoding, achieving zero false prunes and improving program validity by up to 15.2 points.
What we could check
- ·No code link found
- ·No weights link found
- ·No dataset link found
- ·No compute details found
- ✓Limitations stated by the authors
- ✓Reports numbers on named benchmarks (5 benchmarks)
Observed from the paper text and links we have. Absence here means we did not find it, not that it does not exist.
§