The authors introduced a framework adapting the design-effect and participation-ratio from statistics to model path correlation in multi-path LLM reasoning.
Correlated reasoning paths limit the gain from adding more LLM reasoning branches.
Analogy from wireless communications shows that pairwise correctness correlation caps effective sample size, and prompt diversity reduces correlation across 12 benchmarks.
Research Lab
Guangsheng Yu · Litianyi Zhang · Qin Wang · Xu Wang · Mingyuan Li · Shaoxiong Ji · +2 more
University of Technology Sydney · The University of Sydney · CSIRO · ELLIS Institute Finland · University of Turku
Research Digest··3 min read
The authors formalize multi-path LLM reasoning as a diversity combining problem.
Why this paper
From CSIRO and 4 others
In one line
Pairwise correlation of path correctness limits self-consistency gains, and an Adaptive-K rule from a four-path pilot retains full accuracy.
What we could check
- ·No code link found
- ·No weights link found
- ·No dataset link found
- ·No compute details found
- ·No stated limitations found
- ·No benchmark numbers found
Observed from the paper text and links we have. Absence here means we did not find it, not that it does not exist.
§