Benchmark Leaderboard

Top models by HellaSwag score

Sorts are only valid inside this benchmark. A score gap of this benchmark does not map to the same gap on another benchmark, so validate any short-list by checking peer rows and model context/price fit.

#ModelScoreVersionSource
1Clef-omni99.1decision-format (Decision Index 0.2.1 internal run)https://huggingface.co/Cloudflare/clef-omni
2Clef-flash98.6decision-format (Decision Index 0.2.1 internal run)https://huggingface.co/Cloudflare/clef-flash
3Clef98.2decision-format (Decision Index 0.2.1 internal run)https://huggingface.co/Cloudflare/clef
4GPT-4o (05-13)96.410-shothttps://crfm.stanford.edu/helm/classic/latest/
5Claude 3.5 Sonnet96.210-shothttps://crfm.stanford.edu/helm/classic/latest/
6Llama 3.1 405B95.810-shothttps://ai.meta.com/blog/meta-llama-3-1/
7DeepSeek V395.710-shothttps://arxiv.org/abs/2412.19437
8Qwen2.5-72B-Instruct95.6standardhttps://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard
9Llama 3.1 70B Instruct94.210-shothttps://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard
10Mistral Medium93.910-shotresearch
11Mistral Large 293.810-shothttps://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard
12Mixtral 8x22B v0.193.810-shotresearch
13Falcon 180B92.710-shothttps://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard
14Gemma 2 27B92.610-shotresearch
15Llama 3 70B92.410-shotresearch
16Qwen2-7B9210-shothttps://arxiv.org/abs/2407.10671
17Mistral NeMo Instruct (2407)91.810-shothttps://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard
18StarCoder2 15B91.710-shotresearch
19DeepSeek Coder V2 Lite91.410-shothttps://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard
20Llama 3 8B Instruct91.110-shotresearch

Interpretation

Trust when:

  • Use top rows for shortlisting, then validate provider coverage and feature fit before selecting a model.
  • Cross-benchmark consistency is a stronger signal than one-off score dominance.

Don't trust when:

  • Don't compare raw score gaps across different benchmark scales as equivalent.
  • Missing rows in the heatmap can hide benchmark blind spots.
  • No trend data means this is a snapshot; expect drift in fresh refresh cycles.

Cross-benchmark heatmap

Compare top models across selected benchmark families to spot strengths and weak spots. On narrow screens, scroll horizontally to inspect every benchmark.

ModelGPQAHellaSwagHumanEvalMMLU
Clef-omni
47.4
99.1
—
92.7
Clef-flash
51.0
98.6
—
91.8
Clef
48.0
98.2
—
90.3
GPT-4o (05-13)—
96.4
90.2
88.7
Claude 3.5 Sonnet—
96.2
92.0
88.7
Llama 3.1 405B
51.5
95.8
89.0
88.6