MMLU PROactiveGeneral
MMLU PRO
Metric: Accuracy (higher is better)Introduced: 2024
About
Enhanced MMLU with 10-option questions (vs 4 in original), harder problems filtered through expert review, and reduced shortcuts. Maintains coverage of 57 academic subjects.