activeAgents

OSWorld-Verified

Metric: Accuracy (higher is better)Introduced: 2026

Verified OSWorld subset for evaluating desktop computer-use agents on reproducible operating-system tasks.

Models ranked

tracked on this benchmark

Score band

85.0 – 76.7

best → lowest tracked

Snapshot trend

+2.45

Jun 9 → Aug 14 · 1 models

Leaderboard

Tracked models ranked by Accuracy (higher is better).

Compare candidates

#Model variant and provenanceRelative to leaderScore

Claude Fable 5

Version: OSWorld-VerifiedHarness: Not recordedEvaluator: Not recordedObserved: Jun 9, 2026Confidence: Not recordedSource

Notes: DAT-5842: Unstarred in Anthropic's shared launch table; starred rows in that table are Mythos 5 only and are intentionally not seeded for Fable 5.

85.0

Qwen3.8-27B

Version: OSWorld-VerifiedHarness: Not recordedEvaluator: Not recordedObserved: Aug 14, 2026Confidence: Not recordedSource

84.3

Claude Opus 4.8

Version: OSWorld-VerifiedHarness: Not recordedEvaluator: Not recordedObserved: May 28, 2026Confidence: Not recordedSource

Notes: Official Anthropic launch benchmark; Claude Opus 4.8 exposes computer use as a developer API feature.

83.4

Claude Sonnet 5

Version: OSWorld-Verified; 361 tasks, 1080p Ubuntu VM, 100 action steps, adaptive thinking at max effort, pass@1 averaged over 5 runsHarness: Not recordedEvaluator: Not recordedObserved: Jun 30, 2026Confidence: Not recordedSource

81.2

Holo3-122B-A10B

Version: OSWorld-Verified - desktop computer useHarness: Not recordedEvaluator: Not recordedObserved: Mar 31, 2026Confidence: Not recordedSource

Notes: DAT-5701: H Company (self-reported); medium confidence; yes - SOTA at March 2026 launch per H Company.

78.8

GPT-5.5

Version: OSWorld-VerifiedHarness: Not recordedEvaluator: Not recordedObserved: Jun 9, 2026Confidence: Not recordedSource

Notes: DAT-6106: GPT-5.5 score from Anthropic's Fable 5 comparison table; use as same-harness comparison evidence, not OpenAI self-report.

78.7

GPT-5.5 Pro

Version: OSWorld-VerifiedHarness: Not recordedEvaluator: Not recordedObserved: Apr 24, 2026Confidence: Not recordedSource

Notes: Comparable OSWorld-Verified score, but GPT-5.5 Pro does not expose a computer-use API feature in this research pass; this is an eval-harness result.

78.7

Holo3-35B-A3B

Version: OSWorld-Verified - desktop computer useHarness: Not recordedEvaluator: Not recordedObserved: Mar 31, 2026Confidence: Not recordedSource

Notes: DAT-5701: H Company (self-reported); medium confidence; yes.

77.8

Holotron-3-Nano

Version: OSWorld-Verified - desktop computer useHarness: Not recordedEvaluator: Not recordedObserved: Apr 28, 2026Confidence: Not recordedSource

Notes: DAT-5701: H Company (self-reported); medium confidence; yes.

76.7

How to read this benchmark

This benchmark scores models where higher is better. Use scores for directional filtering and shortlisting, not universal quality ranking; then validate pricing, context window, provider availability, and fit for your workload.

Trust this score when

There is a fresh timestamped snapshot (or multiple snapshots) for this benchmark.
The model list covers the same version family you can actually deploy today.
Top candidates overlap with your required routing and feature requirements.

Be cautious when

There is only one benchmark snapshot or the dataset appears stale.
The benchmark metric direction is opposite of your decision objective.
The score difference between options is narrow and likely within implementation variance.

Related benchmarks

Last reviewed: Jun 7, 2026

Resources

Website