BenchCAD 2.1 Core (with tools)
BenchCAD 2.1 Core set of 100 hardware-engineering problems (parts, assemblies, and circuit boards from drawings and rendered images), scored with partial credit using the official scorer. This slug is the with-tools setting (shell, file editor, image zoom). Scores are not comparable with BenchCAD 1.0.
Models ranked
1
tracked on this benchmark
Score band
83.5 – 83.5
best → lowest tracked
Snapshot trend
—
need ≥2 snapshots
Leaderboard
Tracked models ranked by Mean score (higher is better).
Configuration: claude-fable-5-2 (max effort, mean of 5, with tools)
Notes: Anthropic self-reported (lab-published). System card + launch table, retrieved 2026-11-09. Does not move /best rankings (self-reported / raon rule). System card §8.13.2 and launch-post prose (not chart-only): 83.5 with tools at max effort on the Core 100-problem set, official scorer, average of five runs. Without tools the card reports 75.4% (not this row). Scores are not comparable with BenchCAD 1.0. New slug.
How to read this benchmark
This benchmark scores models where higher is better. Use scores for directional filtering and shortlisting, not universal quality ranking; then validate pricing, context window, provider availability, and fit for your workload.
Trust this score when
- There is a fresh timestamped snapshot (or multiple snapshots) for this benchmark.
- The model list covers the same version family you can actually deploy today.
- Top candidates overlap with your required routing and feature requirements.
Be cautious when
- There is only one benchmark snapshot or the dataset appears stale.
- The benchmark metric direction is opposite of your decision objective.
- The score difference between options is narrow and likely within implementation variance.
Related benchmarks
Last reviewed: Nov 9, 2026