LiveCodeBench
Continuously updated coding benchmark sourcing new problems from LeetCode, AtCoder, and Codeforces post-May 2023 to eliminate contamination. Evaluates code generation, self-repair, and execution prediction.
Models ranked
79
tracked on this benchmark
Score band
93.5 – 32.8
best → lowest tracked
Snapshot trend
-6.84
Oct 21 → Nov 6 · 1 models
Leaderboard
Tracked models ranked by Pass@1 (higher is better).
Configuration: Qwen3.8-Omni-Flash
Notes: Qwen Team tech report 'Qwen3.8-Omni: Towards Native Omni-Modal Agents' (arXiv 2609.25611v1, 2026-09-22), Table 2 column 'Qwen3.8-Omni-Flash', row 'LiveCodeBench v6': 92.6. Retrieved 2026-10-26.
Configuration: Qwen3.8-Flash
Notes: Qwen Team tech report 'Qwen3.8-Omni: Towards Native Omni-Modal Agents' (arXiv 2609.25611v1, 2026-09-22), Table 2 column 'Qwen3.8-Flash', row 'LiveCodeBench v6': 91.9. Identity: the report's 'Qwen3.8-Flash' column and the QwenCloud qwen3.8-flash docs page carry the same values as the Qwen3.8-Flash-Next blog/HF card; Qwen's blog says Qwen3.8-Flash is the production served version (1M context, built-in tools) while these evals used a 256K context. Retrieved 2026-10-26.
Notes: Low-confidence secondary-source row; CodingFleet table marked the GPT-5.5 value as approximate.
Notes: Secondary-source competitive-programming row.
Configuration: Solar Pro 4
Notes: Upstage Solar Pro 4 launch blog (2026-08-11), comparison table (Solar Open 2 / Solar Pro 4 / Gap). Asterisked rows 'evaluated in-house under the same internal evaluation environment'. Row 'LiveCodeBench*': Solar Pro 4 87.8. Retrieved 2026-10-26.
Notes: Microsoft AI technical report Table 11 result for MAI-Thinking-1.
Notes: Aleph Alpha first-party HF model card Aleph-Alpha/Kolibri-1 (FP8 release checkpoint), Evaluation > Post-training table; same value in launch blog/landing page. Harness: Aleph-Alpha-Research eval-framework (Harbor for TerminalBench/SWE-Bench), Kolibri at reasoning effort high, each model at its documented context window. BF16 repo card reports 85.1. Self-reported by the lab.
Notes: independent Kaggle benchmark row; most recent reliable o3 LiveCodeBench figure.
How to read this benchmark
This benchmark scores models where higher is better. Use scores for directional filtering and shortlisting, not universal quality ranking; then validate pricing, context window, provider availability, and fit for your workload.
Trust this score when
- There is a fresh timestamped snapshot (or multiple snapshots) for this benchmark.
- The model list covers the same version family you can actually deploy today.
- Top candidates overlap with your required routing and feature requirements.
Be cautious when
- There is only one benchmark snapshot or the dataset appears stale.
- The benchmark metric direction is opposite of your decision objective.
- The score difference between options is narrow and likely within implementation variance.
Related benchmarks
Last reviewed: Apr 15, 2026