activeMultimodal

Chartography — No Tools

Metric: Accuracy (higher is better)Introduced: 2026

Chart understanding and reasoning evaluated without tool access. Kept separate from chartography-with-tools because tool use changes the task. Anthropic's Fable 5.2 system card reports max-effort, five-run averages on its own runs.

Models ranked

1

tracked on this benchmark

Score band

73.4 – 73.4

best → lowest tracked

Snapshot trend

—

need ≥2 snapshots

Leaderboard

Tracked models ranked by Accuracy (higher is better).

Compare candidates
#Model variant and provenanceScore
1

Configuration: claude-fable-5-2 (max effort, mean of 5 runs, no tools)

Version: Chartography no toolsHarness: Official Chartography tasks and expert ranges; no tools; Gemini 3.5 Flash grader; average of five runsEvaluator: AnthropicObserved: Nov 9, 2026Confidence: self-reportedSource

Notes: Anthropic self-reported (lab-published). System card + launch table, retrieved 2026-11-09. Does not move /best rankings (self-reported / raon rule). Launch table and §8.13.1: 73.4% without tools at max effort, average of five runs, Anthropic's own runs. Medium-effort 66.4% is mentioned in the launch-post chart caption and is not this row. New slug: catalog only had chartography-with-tools.

73.4

How to read this benchmark

This benchmark scores models where higher is better. Use scores for directional filtering and shortlisting, not universal quality ranking; then validate pricing, context window, provider availability, and fit for your workload.

Trust this score when

  • There is a fresh timestamped snapshot (or multiple snapshots) for this benchmark.
  • The model list covers the same version family you can actually deploy today.
  • Top candidates overlap with your required routing and feature requirements.

Be cautious when

  • There is only one benchmark snapshot or the dataset appears stale.
  • The benchmark metric direction is opposite of your decision objective.
  • The score difference between options is narrow and likely within implementation variance.

Related benchmarks

Last reviewed: Nov 9, 2026

Resources