LLM Reference
activeAgents

OSWorld-G

Metric: Accuracy (higher is better)Introduced: 2025

OSWorld grounding benchmark variant for measuring GUI element grounding and localization in desktop computer-use environments.

Models ranked

5

tracked on this benchmark

Score band

79.0 – 61.6

best → lowest tracked

Snapshot trend

+5.31

Sep 25 → Apr 28 · 1 models

Leaderboard

Tracked models ranked by Accuracy (higher is better).

Compare candidates
#Model variant and provenanceScore
1
Holo2-235B-A22B
Version: OSWorld-G - UI groundingHarness: Not recordedEvaluator: Not recordedObserved: Nov 13, 2025Confidence: Not recordedSource

Notes: DAT-5701: H Company (self-reported); medium confidence; yes.

79.0
2
Holo2-30B-A3B
Version: OSWorld-G - UI groundingHarness: Not recordedEvaluator: Not recordedObserved: Nov 13, 2025Confidence: Not recordedSource

Notes: DAT-5701: H Company (self-reported); medium confidence; yes.

76.1
3
Holotron-3-Nano
Version: OSWorld-G - UI groundingHarness: Not recordedEvaluator: Not recordedObserved: Apr 28, 2026Confidence: Not recordedSource

Notes: DAT-5701: H Company (self-reported); medium confidence; yes.

72.0
4
Holo1.5-72B
Version: OSWorld-G - UI groundingHarness: Not recordedEvaluator: Not recordedObserved: Sep 25, 2025Confidence: Not recordedSource

Notes: DAT-5701: H Company (self-reported); medium confidence; yes.

71.8
5
Holo1.5-3B
Version: OSWorld-G - UI groundingHarness: Not recordedEvaluator: Not recordedObserved: Sep 25, 2025Confidence: Not recordedSource

Notes: DAT-5701: H Company (self-reported); medium confidence; yes.

61.6

How to read this benchmark

This benchmark scores models where higher is better. Use scores for directional filtering and shortlisting, not universal quality ranking; then validate pricing, context window, provider availability, and fit for your workload.

Trust this score when

  • There is a fresh timestamped snapshot (or multiple snapshots) for this benchmark.
  • The model list covers the same version family you can actually deploy today.
  • Top candidates overlap with your required routing and feature requirements.

Be cautious when

  • There is only one benchmark snapshot or the dataset appears stale.
  • The benchmark metric direction is opposite of your decision objective.
  • The score difference between options is narrow and likely within implementation variance.

Related benchmarks

Last reviewed: Jun 7, 2026

Resources