GSM8KactiveMathematics

GSM8K: Grade School Math 8K

Metric: Accuracy (higher is better)Introduced: 2021

8,500 grade school math word problems requiring 2–8 steps of arithmetic reasoning. Widely used for evaluating chain-of-thought reasoning; top models now near 100%.

Models ranked

16

tracked on this benchmark

Score band

96.7 – 67.3

best → lowest tracked

Snapshot trend

-7.32

Oct 6 → Oct 15 · 3 models

Leaderboard

Tracked models ranked by Accuracy (higher is better).

Compare candidates
#Model variant and provenanceScore
1
Version: GSM8K (thinking mode)Harness: Not recordedEvaluator: Not recordedObserved: Oct 13, 2026Confidence: Not recordedSource
96.7
2
Version: Not recordedHarness: Not recordedEvaluator: Not recordedObserved: May 28, 2026Confidence: Not recordedSource
95.7
3
Version: 8-shot, instruct model (accuracy)Harness: Not recordedEvaluator: Not recordedObserved: Jun 7, 2026Confidence: Not recordedSource
94.2
4
Version: Not recordedHarness: Not recordedEvaluator: Not recordedObserved: May 28, 2026Confidence: Not recordedSource
93.0
5
Version: 8-shot, instruct model (accuracy)Harness: Not recordedEvaluator: Not recordedObserved: Jun 7, 2026Confidence: Not recordedSource
92.5
6
Version: 8-shot, accuracy; default TwoTower diffusion decoding at confidence_threshold=0.8, block_size=16, BF16 on 2xH100; evaluator/harness not published on the model cardHarness: Not recordedEvaluator: Not recordedObserved: Jun 25, 2026Confidence: Not recordedSource
90.1
7
Version: Not recordedHarness: Not recordedEvaluator: Not recordedObserved: May 28, 2026Confidence: Not recordedSource
89.7
8
Version: 8-shot, instruct model (accuracy)Harness: Not recordedEvaluator: Not recordedObserved: Jun 7, 2026Confidence: Not recordedSource
86.9
9
Version: Not recordedHarness: Not recordedEvaluator: Not recordedObserved: May 28, 2026Confidence: Not recordedSource
84.9
10
Version: From official IBM HuggingFace model card (8-shot)Harness: Not recordedEvaluator: Not recordedObserved: Oct 6, 2026Confidence: Not recordedSource
84.7
11
Version: Not recordedHarness: Not recordedEvaluator: Not recordedObserved: May 28, 2026Confidence: Not recordedSource
82.7
12
Version: From official IBM HuggingFace model card (8-shot)Harness: Not recordedEvaluator: Not recordedObserved: Oct 6, 2026Confidence: Not recordedSource
81.3
13
Version: decision-format (Decision Index 0.2.1 internal run)Harness: Not recordedEvaluator: Not recordedObserved: Oct 15, 2026Confidence: Not recordedSource

Notes: Cloudflare first-party HF card, Results > Decision Index table ('GSM8K (accuracy)'). Posed as a decision over the benchmark's options in Cloudflare's internal run of the Decision Index 0.2.1 suite, not standard generative eval; not comparable to LLM rows without the variant.

80.8
14
Version: Not recordedHarness: Not recordedEvaluator: Not recordedObserved: May 28, 2026Confidence: Not recordedSource
80.6
15
Version: decision-format (Decision Index 0.2.1 internal run)Harness: Not recordedEvaluator: Not recordedObserved: Oct 15, 2026Confidence: Not recordedSource

Notes: Cloudflare first-party HF card, Results > Decision Index table ('GSM8K (accuracy)'). Posed as a decision over the benchmark's options in Cloudflare's internal run of the Decision Index 0.2.1 suite, not standard generative eval; not comparable to LLM rows without the variant.

79.0
16
Version: decision-format (Decision Index 0.2.1 internal run)Harness: Not recordedEvaluator: Not recordedObserved: Oct 15, 2026Confidence: Not recordedSource

Notes: Cloudflare first-party HF card, Results > Decision Index table ('GSM8K (accuracy)'). Posed as a decision over the benchmark's options in Cloudflare's internal run of the Decision Index 0.2.1 suite, not standard generative eval; not comparable to LLM rows without the variant.

67.3

How to read this benchmark

This benchmark scores models where higher is better. Use scores for directional filtering and shortlisting, not universal quality ranking; then validate pricing, context window, provider availability, and fit for your workload.

Trust this score when

  • There is a fresh timestamped snapshot (or multiple snapshots) for this benchmark.
  • The model list covers the same version family you can actually deploy today.
  • Top candidates overlap with your required routing and feature requirements.

Be cautious when

  • There is only one benchmark snapshot or the dataset appears stale.
  • The benchmark metric direction is opposite of your decision objective.
  • The score difference between options is narrow and likely within implementation variance.

Related benchmarks

Last reviewed: Apr 15, 2026