From Crowdsourced Data to High-Quality Benchmarks: Arena-Hard and BenchBuilder Pipeline (arXiv 2406.11939)
paper
Fields
id
sources/meth-arena-hard-benchbuilder-arxivPublisher
arXiv (UC Berkeley / LMSYS)
Kind
paper
Published
2024-06-17
Accessed
2026-10-04
notes
arXiv preprint, no venue claim in comments. Introduces BenchBuilder pipeline and Arena-Hard-Auto benchmark. Claims 3x higher separation than MT-Bench and 98.6% correlation with human preference rankings.
Notes
arXiv preprint, no venue claim in comments. Introduces BenchBuilder pipeline and Arena-Hard-Auto benchmark. Claims 3x higher separation than MT-Bench and 98.6% correlation with human preference rankings.
Cross-references
This record references no other records.