activeCodingAgents

Frontier-Bench v0.1

Metric: Mean reward (higher is better)Introduced: 2026

A 74-task benchmark across seven professional domains for long-horizon autonomous work. Anthropic's Opus 5 system-card run uses the mini-SWE-agent harness, a Google Kubernetes Engine backend, and mean reward over five attempts per task. High benchmark score alone doesn't make a model the right pick — weigh it against pricing, API availability, and release date.

Models ranked

tracked on this benchmark

Score band

44.4 – 44.4

best → lowest tracked

Snapshot trend

—

need ≥2 snapshots

Leaderboard

Tracked models ranked by Mean reward (higher is better).

Compare candidates

#Model variant and provenanceRelative to leaderScore

Claude Opus 5

Configuration: xhigh effort

Version: Frontier-Bench v0.1Harness: 74 tasks; mini-SWE-agent on Google Kubernetes Engine; mean reward over five attempts per taskEvaluator: AnthropicObserved: Jul 24, 2026Confidence: confirmedSource

Notes: Vendor-reported. Source: p.152, Figure 8.5. About 5% of API calls were refused and 4% of trials fell back to Opus 4.8; maximum effort scored 43.0 within noise of xhigh.

44.4

How to read this benchmark

This benchmark scores models where higher is better. Scores are useful for directional filtering and shortlisting — not for universal quality ranking. Prefer benchmarks closest to your workload, then validate the linked model pages for pricing, context window, and provider availability.

Trust this score when

There is a fresh timestamped snapshot (or multiple snapshots) for this benchmark.
The model list covers the same version family you can actually deploy today.
Top candidates overlap with your required routing and feature requirements.

Be cautious when

There is only one benchmark snapshot or the dataset appears stale.
The benchmark metric direction is opposite of your decision objective.
The score difference between options is narrow and likely within implementation variance.

FAQ

What does the Frontier-Bench v0.1 benchmark measure?

A 74-task benchmark across seven professional domains for long-horizon autonomous work. Anthropic's Opus 5 system-card run uses the mini-SWE-agent harness, a Google Kubernetes Engine backend, and mean reward over five attempts per task. On this page it lists 1 tracked model variant where higher is better.

Is a higher Frontier-Bench v0.1 score always better?

For this benchmark, higher is better. A high score helps you shortlist, but confirm pricing, context window, and provider availability on each model page before committing — the top scorer is not always the right pick for your workload or budget.

How current is this Frontier-Bench v0.1 data?

This benchmark was last reviewed on Jul 26, 2026. Re-check the linked model pages for the freshest provider and pricing detail.