
Similar language models draw more decisive votes than rankings predict
Bakshi and colleagues test whether Chatbot Arena's single-score ranking model accurately describes comparisons between closely related language models. They find that voters distinguish model siblings more decisively than their scores predict, but a compact correction improves prediction mainly by modelling ties rather than establishing better head-to-head win odds.












