activeCoding

DeepSWE 1.0

Metric: Pass@1 (higher is better)Introduced: 2026Superseded by: deepswe-1-1

DeepSWE 1.0 is Datacurve's long-horizon software-engineering benchmark for frontier coding agents, using 113 original tasks across 91 repositories and 5 languages. Model scores must preserve the evaluator and harness used for each run because xAI reports Grok 4.5's DeepSWE 1.0 score from a Datacurve-created eval run with each model provider's harnesses by AA, not the public Datacurve leaderboard table.