LLM Reference
activeCoding

Program Bench

Metric: Score (higher is better)Introduced: 2026

Moonshot-reported program-generation benchmark used in Kimi K2.7-Code launch comparison tables. Keep separate from public SWE-bench variants. High benchmark score alone doesn't make a model the right pick — weigh it against pricing, API availability, and release date.

Models ranked

2

tracked on this benchmark

Score band

77.8 – 53.6

best → lowest tracked

Snapshot trend

+24.20

Jun 12 → Jul 16 · 1 models

Leaderboard

Tracked models ranked by Score (higher is better).

Compare candidates
#Model variant and provenanceScore
1
Kimi K3
Version: KimiCode harness; max reasoning effortHarness: Not recordedEvaluator: Not recordedObserved: Jul 16, 2026Confidence: Not recordedSource

Notes: Model variant: Kimi K3 (max reasoning effort). Benchmark variant: Program Bench. Harness/evaluator: KimiCode. Source posture: Moonshot/Kimi self-reported launch table; confidence: medium because the value is vendor-reported and not independently reproduced. Recommended seed value: 77.8.

77.8
2
Kimi K2.7-Code
Version: official, Moonshot-reportedHarness: Not recordedEvaluator: Not recordedObserved: Jun 12, 2026Confidence: Not recordedSource

Notes: DAT-6271: Moonshot proprietary benchmark; GPT-5.5 score in Moonshot's comparison table should not be mixed with public SWE-bench rows.

53.6

How to read this benchmark

This benchmark scores models where higher is better. Scores are useful for directional filtering and shortlisting — not for universal quality ranking. Prefer benchmarks closest to your workload, then validate the linked model pages for pricing, context window, and provider availability.

Trust this score when

  • There is a fresh timestamped snapshot (or multiple snapshots) for this benchmark.
  • The model list covers the same version family you can actually deploy today.
  • Top candidates overlap with your required routing and feature requirements.

Be cautious when

  • There is only one benchmark snapshot or the dataset appears stale.
  • The benchmark metric direction is opposite of your decision objective.
  • The score difference between options is narrow and likely within implementation variance.

FAQ

What does the Program Bench benchmark measure?

Moonshot-reported program-generation benchmark used in Kimi K2.7-Code launch comparison tables. Keep separate from public SWE-bench variants. On this page it lists 2 tracked model variants where higher is better.

Is a higher Program Bench score always better?

For this benchmark, higher is better. A high score helps you shortlist, but confirm pricing, context window, and provider availability on each model page before committing — the top scorer is not always the right pick for your workload or budget.

How current is this Program Bench data?

This benchmark was last reviewed on Jun 19, 2026. The tracked score average moved +24.20 points across the last 2 snapshots.

Related benchmarks

Last reviewed: Jun 19, 2026

Resources