activeTool use

MCP-Atlas

Metric: Score (higher is better)

Benchmark for evaluating model performance on Model Context Protocol tool use tasks

Models ranked

27

tracked on this benchmark

Score band

89.2 – 29.5

best → lowest tracked

Snapshot trend

-33.62

Oct 26 → Nov 6 · 2 models

Leaderboard

Tracked models ranked by Score (higher is better).

Compare candidates
#Model variant and provenanceScore
1
Version: MCP-Atlas; xhigh reasoning effortHarness: Not recordedEvaluator: Not recordedObserved: Oct 15, 2026Confidence: Not recordedSource

Notes: Meta HF model card Benchmarks table, xhigh reasoning effort.

89.2
2

Configuration: Muse Spark 1.1 (xhigh)

Version: MCP-Atlas (1000 tasks, 36 MCP servers)Harness: Scale AI MCP-Atlas evaluationEvaluator: Scale AIObserved: Oct 17, 2026Confidence: confirmedSource

Notes: Muse Spark 1.1 model page benchmark table (raw HTML parsed). Methodology: evaluation report https://ai.meta.com/static-resource/muse-spark-1-1-evaluation-report/ (2026-07-09). All Muse Spark 1.1 results run via Meta Model API at xhigh reasoning effort (report §5.1, p.100-101). Report §5.2.1: 'Results are sourced from Scale AI' (benchmark owner). Retrieved 2026-10-17.

88.1
3

Configuration: Fable 5.1

Version: MCP-Atlas (Scale leaderboard)Harness: Scale MCP-Atlas harnessEvaluator: Scale AIObserved: Oct 26, 2026Confidence: confirmedSource

Notes: Scale AI MCP-Atlas leaderboard (headless-Chrome capture 2026-10-26). Row: rank 2 'Fable 5.1 NEW', 87.20 ± 2.05. The page's methodology stamp reads 'Updated April 8, 2026', which predates Fable 5.1; the row itself carries the board's NEW badge. Effort level is not shown on the board. Scale runs the evaluation with its own MCP-Atlas harness. Retrieved 2026-10-26.

87.2
4
Version: 500-task public subset; 100-turn limit; Gemini 3.1 Pro judge; max reasoning effortHarness: Not recordedEvaluator: Not recordedObserved: Jul 16, 2026Confidence: Not recordedSource

Notes: Model variant: Kimi K3 (max reasoning effort). Benchmark variant: MCP-Atlas 500-task public subset with a 100-turn limit. Harness/evaluator: Gemini 3.1 Pro judge; remaining harness/evaluator details not disclosed by Moonshot. Source posture: Moonshot/Kimi self-reported launch table; confidence: medium because the value is vendor-reported and not independently reproduced. Recommended seed value: 84.2.

84.2
5
Version: MCP-Atlas (accuracy%)Harness: Not recordedEvaluator: Not recordedObserved: Jun 7, 2026Confidence: Not recordedSource
83.6
6
Version: MCP-AtlasHarness: Not recordedEvaluator: Not recordedObserved: May 28, 2026Confidence: Not recordedSource

Notes: Low-confidence secondary-source row; useful as supporting Anthropic MCP-native evidence.

82.2
7
Version: MCP AtlasHarness: Not recordedEvaluator: Not recordedObserved: Oct 16, 2026Confidence: Not recordedSource

Notes: Reflection first-party final model card (HF https://huggingface.co/reflection/Beam-1.0-501B-A23B, BF16 column), retrieved 2026-10-16. Replaces 2026-10-05 preview-blog score 78.7. Card label 'MCP Atlas'. Lab self-reported.

80.8
8
Version: MCP-Atlas (accuracy%)Harness: Not recordedEvaluator: Not recordedObserved: Jun 7, 2026Confidence: Not recordedSource
77.3
9
Version: MCP-AtlasHarness: Not recordedEvaluator: Not recordedObserved: Jun 13, 2026Confidence: Not recordedSource
76.8
10
Version: MCP-Atlas (accuracy%)Harness: Not recordedEvaluator: Not recordedObserved: Jun 7, 2026Confidence: Not recordedSource
76.4
11
Version: official, Moonshot-reportedHarness: Not recordedEvaluator: Not recordedObserved: Jun 12, 2026Confidence: Not recordedSource

Notes: Moonshot-run MCP tool-use benchmark. Compare with other MCP Atlas rows cautiously when source harnesses differ.

76.0
12

Configuration: High Reasoning

Version: MCP Atlas (Public)Harness: Not recordedEvaluator: Not recordedObserved: Aug 10, 2026Confidence: Not recordedSource

Notes: Score confirmed by the Muse Glimmer technical report (Oct 19, 2026), Table 2 (Tool Use), PDF p.4, Muse Glimmer (high) = 75.5; internal run (App. A).

75.5
13
Version: MCP-Atlas (accuracy%)Harness: Not recordedEvaluator: Not recordedObserved: Jun 7, 2026Confidence: Not recordedSource
75.3
14
Version: MCP-AtlasHarness: Not recordedEvaluator: Not recordedObserved: Apr 24, 2026Confidence: Not recordedSource

Notes: Low-confidence secondary-source row; useful as supporting tool-use evidence.

75.3
15

Configuration: Ornith-1.5-122B

Version: MCP-Atlas, 500-task public subset, thinking mode, Claude 4.8 Opus judge (self-reported, official model card)Harness: Not recordedEvaluator: OrnithObserved: Nov 6, 2026Confidence: self-reportedSource

Notes: Self-reported by Ornith. Ornith first-party HF model card Ornith-1.5-122B, benchmark table (column 'Ornith-1.5-122B'). Retrieved 2026-11-06. MCP-Atlas, 500-task public subset, thinking mode, Claude 4.8 Opus judge: 74.6.

74.6
16
Version: MiniMax-reported public setHarness: Not recordedEvaluator: Not recordedObserved: Jun 1, 2026Confidence: Not recordedSource
74.2
17
Version: llm-stats shows 0 (accuracy%)Harness: Not recordedEvaluator: Not recordedObserved: Jun 7, 2026Confidence: Not recordedSource
74.1
18
Version: independent evaluation (BenchLM, June 2026)Harness: Not recordedEvaluator: Not recordedObserved: Jun 18, 2026Confidence: Not recordedSource
71.8
19
Version: independent evaluation (BenchLM, June 2026)Harness: Not recordedEvaluator: Not recordedObserved: Jun 18, 2026Confidence: Not recordedSource
69.4
20
Version: MCP-Atlas (accuracy%)Harness: Not recordedEvaluator: Not recordedObserved: Jun 7, 2026Confidence: Not recordedSource
69.2
21
Version: MCPAtlas pass@1, V4-Flash Think MaxHarness: Not recordedEvaluator: Not recordedObserved: Jul 3, 2026Confidence: Not recordedSource
69.0
22
Version: MCP-Atlas (accuracy%)Harness: Not recordedEvaluator: Not recordedObserved: Jun 7, 2026Confidence: Not recordedSource
62.7
23

Configuration: Solar Pro 4

Version: MCP-Atlas, Upstage in-houseHarness: Not recordedEvaluator: UpstageObserved: Oct 29, 2026Confidence: self-reportedSource

Notes: Upstage Solar Pro 4 launch blog (2026-08-11), comparison table (Solar Open 2 / Solar Pro 4 / Gap). Asterisked rows 'evaluated in-house under the same internal evaluation environment'. Row 'MCP-Atlas*': Solar Pro 4 61.4. Retrieved 2026-10-29.

61.4
24
Version: llm-stats shows 0 (accuracy%)Harness: Not recordedEvaluator: Not recordedObserved: Jun 7, 2026Confidence: Not recordedSource
61.3
25
Version: MCP-Atlas (accuracy%)Harness: Not recordedEvaluator: Not recordedObserved: Jun 7, 2026Confidence: Not recordedSource
55.9
Showing the top 25 of 27 tracked models. Browse all models.

How to read this benchmark

This benchmark scores models where higher is better. Use scores for directional filtering and shortlisting, not universal quality ranking; then validate pricing, context window, provider availability, and fit for your workload.

Trust this score when

  • There is a fresh timestamped snapshot (or multiple snapshots) for this benchmark.
  • The model list covers the same version family you can actually deploy today.
  • Top candidates overlap with your required routing and feature requirements.

Be cautious when

  • There is only one benchmark snapshot or the dataset appears stale.
  • The benchmark metric direction is opposite of your decision objective.
  • The score difference between options is narrow and likely within implementation variance.

Related benchmarks

Last reviewed: May 20, 2026

Resources