LLM Reference
AIME 2024activeMathematics

AIME 2024

Metric: Score (higher is better)

About

American Invitational Mathematics Examination 2024 problems

How to read this benchmark

This benchmark uses a scoring system where higher is better. Scores are useful for directional filtering and model shortlisting, not for universal quality ranking.

Interpretation checklist: prefer benchmarks that are closest to your workload style, then validate against the linked model pages for pricing, context window, and provider availability.

Trust when:

  • There is a fresh timestamped snapshot (or multiple snapshots) for this benchmark.
  • Model list covers the same version family you can actually deploy today.
  • Top candidates overlap with your required routing and feature requirements.

Don't trust when:

  • There is only one benchmark snapshot or the dataset appears stale.
  • Benchmark metric direction is opposite of your decision objective.
  • The score difference between options is narrow and likely within implementation variance.

Current modeled score band for tracked entries is roughly 96.7 – 85.7.

Window

Apr 29 to May 16

last 3 snapshots

Mean delta

-28.20

score points

Coverage

1

models in latest snapshot

Leaderboard preview (top 5)

  1. 1. o396.7
  2. 2. Gemini 2.5 Pro92.0
  3. 3. DeepSeek R1 052891.4
  4. 4. o3 Mini87.3
  5. 5. Qwen3-235B-A22B85.7

Resources

Website