LLM Reference
activeAgents

OSWorld-G

Metric: Accuracy (higher is better)Introduced: 2025

OSWorld grounding benchmark variant for measuring GUI element grounding and localization in desktop computer-use environments. High benchmark score alone doesn't make a model the right pick — weigh it against pricing, API availability, and release date.

Models ranked

5

tracked on this benchmark

Score band

79.0 – 61.6

best → lowest tracked

Snapshot trend

+5.31

Sep 25 → Apr 28 · 1 models

Leaderboard

Tracked models ranked by Accuracy (higher is better).

Compare candidates
#Model variant and provenanceScore
1
Holo2-235B-A22B
Version: OSWorld-G - UI groundingHarness: Not recordedEvaluator: Not recordedObserved: Nov 13, 2025Confidence: Not recordedSource

Notes: DAT-5701: H Company (self-reported); medium confidence; yes.

79.0
2
Holo2-30B-A3B
Version: OSWorld-G - UI groundingHarness: Not recordedEvaluator: Not recordedObserved: Nov 13, 2025Confidence: Not recordedSource

Notes: DAT-5701: H Company (self-reported); medium confidence; yes.

76.1
3
Holotron-3-Nano
Version: OSWorld-G - UI groundingHarness: Not recordedEvaluator: Not recordedObserved: Apr 28, 2026Confidence: Not recordedSource

Notes: DAT-5701: H Company (self-reported); medium confidence; yes.

72.0
4
Holo1.5-72B
Version: OSWorld-G - UI groundingHarness: Not recordedEvaluator: Not recordedObserved: Sep 25, 2025Confidence: Not recordedSource

Notes: DAT-5701: H Company (self-reported); medium confidence; yes.

71.8
5
Holo1.5-3B
Version: OSWorld-G - UI groundingHarness: Not recordedEvaluator: Not recordedObserved: Sep 25, 2025Confidence: Not recordedSource

Notes: DAT-5701: H Company (self-reported); medium confidence; yes.

61.6

How to read this benchmark

This benchmark scores models where higher is better. Scores are useful for directional filtering and shortlisting — not for universal quality ranking. Prefer benchmarks closest to your workload, then validate the linked model pages for pricing, context window, and provider availability.

Trust this score when

  • There is a fresh timestamped snapshot (or multiple snapshots) for this benchmark.
  • The model list covers the same version family you can actually deploy today.
  • Top candidates overlap with your required routing and feature requirements.

Be cautious when

  • There is only one benchmark snapshot or the dataset appears stale.
  • The benchmark metric direction is opposite of your decision objective.
  • The score difference between options is narrow and likely within implementation variance.

FAQ

What does the OSWorld-G benchmark measure?

OSWorld grounding benchmark variant for measuring GUI element grounding and localization in desktop computer-use environments. On this page it lists 5 tracked model variants where higher is better.

Is a higher OSWorld-G score always better?

For this benchmark, higher is better. A high score helps you shortlist, but confirm pricing, context window, and provider availability on each model page before committing — the top scorer is not always the right pick for your workload or budget.

How current is this OSWorld-G data?

This benchmark was last reviewed on Jun 7, 2026. The tracked score average moved +5.31 points across the last 3 snapshots.

Related benchmarks

Last reviewed: Jun 7, 2026

Resources