ModelRefs / Chatbot Arena ELO Methodology and Evidence
Chatbot Arena ELO Methodology and Evidence
LMSYS crowd-sourced pairwise preference leaderboard across open and closed models. Methodology, dataset provenance, and citation sources for Chatbot Arena ELO.
Overview
LMSYS crowd-sourced pairwise preference leaderboard across open and closed models.
How it is measured: Bradley-Terry ELO from 1M+ anonymous human preference votes; open and closed models ranked together.
How this benchmark is scored
| Category | open-source |
|---|---|
| Maximum score | 2000 ELO |
| Direction | Higher is better |
Primary source: https://lmarena.ai/
Continue your research
Use these connected ModelRefs sections to compare alternatives, inspect implementation paths, and review the evidence and governance boundaries relevant to Chatbot Arena ELO Methodology and Evidence.
Frequently asked questions
What does the Chatbot Arena ELO benchmark measure?
LMSYS crowd-sourced pairwise preference leaderboard across open and closed models.
What is the methodology?
Bradley-Terry ELO from 1M+ anonymous human preference votes; open and closed models ranked together.