activeReasoning

HellaSwag

Metric: Accuracy (higher is better)Introduced: 2019

Commonsense sentence-completion benchmark using adversarially filtered wrong answers. Top LLMs now exceed 95% accuracy.

Models ranked

51

tracked on this benchmark

Score band

99.1 – 78.9

best → lowest tracked

Snapshot trend

+11.03

Sep 1 → Oct 15 · 3 models

Leaderboard

Tracked models ranked by Accuracy (higher is better).

Compare candidates
#Model variant and provenanceScore
1
Version: decision-format (Decision Index 0.2.1 internal run)Harness: Not recordedEvaluator: Not recordedObserved: Oct 15, 2026Confidence: Not recordedSource

Notes: Cloudflare first-party HF card, Results > Decision Index table ('HellaSwag (accuracy)'). Posed as a decision over the benchmark's options in Cloudflare's internal run of the Decision Index 0.2.1 suite, not standard generative eval; not comparable to LLM rows without the variant.

99.1
2
Version: decision-format (Decision Index 0.2.1 internal run)Harness: Not recordedEvaluator: Not recordedObserved: Oct 15, 2026Confidence: Not recordedSource

Notes: Cloudflare first-party HF card, Results > Decision Index table ('HellaSwag (accuracy)'). Posed as a decision over the benchmark's options in Cloudflare's internal run of the Decision Index 0.2.1 suite, not standard generative eval; not comparable to LLM rows without the variant.

98.6
3
Version: decision-format (Decision Index 0.2.1 internal run)Harness: Not recordedEvaluator: Not recordedObserved: Oct 15, 2026Confidence: Not recordedSource

Notes: Cloudflare first-party HF card, Results > Decision Index table ('HellaSwag (accuracy)'). Posed as a decision over the benchmark's options in Cloudflare's internal run of the Decision Index 0.2.1 suite, not standard generative eval; not comparable to LLM rows without the variant.

98.2
4
Version: 10-shotHarness: Not recordedEvaluator: Not recordedObserved: Mar 6, 2026Confidence: Not recordedSource
96.4
5
Version: 10-shotHarness: Not recordedEvaluator: Not recordedObserved: Mar 6, 2026Confidence: Not recordedSource
96.2
6
Version: 10-shotHarness: Not recordedEvaluator: Not recordedObserved: Mar 6, 2026Confidence: Not recordedSource
95.8
7
Version: 10-shotHarness: Not recordedEvaluator: Not recordedObserved: Mar 6, 2026Confidence: Not recordedSource
95.7
8
Version: standardHarness: Not recordedEvaluator: Not recordedObserved: Mar 6, 2026Confidence: Not recordedSource
95.6
9
Version: 10-shotHarness: Not recordedEvaluator: Not recordedObserved: Mar 6, 2026Confidence: Not recordedSource
94.2
10
Version: 10-shotHarness: Not recordedEvaluator: Not recordedObserved: Mar 6, 2026Confidence: Not recordedSource: research
93.9
11
Version: 10-shotHarness: Not recordedEvaluator: Not recordedObserved: Mar 6, 2026Confidence: Not recordedSource
93.8
12
Version: 10-shotHarness: Not recordedEvaluator: Not recordedObserved: Mar 6, 2026Confidence: Not recordedSource: research
93.8
13
Version: 10-shotHarness: Not recordedEvaluator: Not recordedObserved: Mar 6, 2026Confidence: Not recordedSource
92.7
14
Version: 10-shotHarness: Not recordedEvaluator: Not recordedObserved: Mar 6, 2026Confidence: Not recordedSource: research
92.6
15
Version: 10-shotHarness: Not recordedEvaluator: Not recordedObserved: Mar 6, 2026Confidence: Not recordedSource: research
92.4
16
Version: 10-shotHarness: Not recordedEvaluator: Not recordedObserved: Mar 6, 2026Confidence: Not recordedSource
92.0
17
Version: 10-shotHarness: Not recordedEvaluator: Not recordedObserved: Mar 6, 2026Confidence: Not recordedSource
91.8
18
Version: 10-shotHarness: Not recordedEvaluator: Not recordedObserved: Mar 6, 2026Confidence: Not recordedSource: research
91.7
19
Version: 10-shotHarness: Not recordedEvaluator: Not recordedObserved: Mar 6, 2026Confidence: Not recordedSource
91.4
20
Version: 10-shotHarness: Not recordedEvaluator: Not recordedObserved: Mar 6, 2026Confidence: Not recordedSource: research
91.1
21
Version: 10-shotHarness: Not recordedEvaluator: Not recordedObserved: Mar 6, 2026Confidence: Not recordedSource
90.9
22
Version: 10-shotHarness: Not recordedEvaluator: Not recordedObserved: Mar 6, 2026Confidence: Not recordedSource: research
90.8
23
Version: 10-shotHarness: Not recordedEvaluator: Not recordedObserved: Mar 6, 2026Confidence: Not recordedSource
90.8
24
Version: 10-shotHarness: Not recordedEvaluator: Not recordedObserved: Mar 6, 2026Confidence: Not recordedSource
90.2
25
Version: 10-shotHarness: Not recordedEvaluator: Not recordedObserved: Mar 6, 2026Confidence: Not recordedSource
90.2
Showing the top 25 of 51 tracked models. Browse all models.

How to read this benchmark

This benchmark scores models where higher is better. Use scores for directional filtering and shortlisting, not universal quality ranking; then validate pricing, context window, provider availability, and fit for your workload.

Trust this score when

  • There is a fresh timestamped snapshot (or multiple snapshots) for this benchmark.
  • The model list covers the same version family you can actually deploy today.
  • Top candidates overlap with your required routing and feature requirements.

Be cautious when

  • There is only one benchmark snapshot or the dataset appears stale.
  • The benchmark metric direction is opposite of your decision objective.
  • The score difference between options is narrow and likely within implementation variance.

Related benchmarks

Last reviewed: Apr 15, 2026