LLM Reference
activeAgents

AndroidWorld

Metric: Accuracy (higher is better)Introduced: 2024

Android mobile-agent benchmark for measuring task completion and GUI automation on Android environments.

Models ranked

4

tracked on this benchmark

Score band

79.3 – 71.0

best → lowest tracked

Snapshot trend

+2.17

Nov 13 → Jun 1 · 3 models

Leaderboard

Tracked models ranked by Accuracy (higher is better).

Compare candidates
#Model variant and provenanceScore
1
Holo3.1-35B-A3B
Version: AndroidWorld - mobile agentHarness: Not recordedEvaluator: Not recordedObserved: Jun 1, 2026Confidence: Not recordedSource

Notes: DAT-5701: H Company (self-reported); medium confidence; yes.

79.3
2
Holo2-30B-A3B
Version: AndroidWorld - mobile agentHarness: Not recordedEvaluator: Not recordedObserved: Nov 13, 2025Confidence: Not recordedSource

Notes: DAT-5701: H Company (self-reported); medium confidence; yes.

71.6
3
Holo3.1-4B
Version: AndroidWorld - mobile agentHarness: Not recordedEvaluator: Not recordedObserved: Jun 1, 2026Confidence: Not recordedSource

Notes: DAT-5701: H Company (self-reported); medium confidence; yes.

71.0
4
Holo3.1-9B
Version: AndroidWorld - mobile agentHarness: Not recordedEvaluator: Not recordedObserved: Jun 1, 2026Confidence: Not recordedSource

Notes: DAT-5701: H Company (self-reported); medium confidence; yes.

71.0

How to read this benchmark

This benchmark scores models where higher is better. Use scores for directional filtering and shortlisting, not universal quality ranking; then validate pricing, context window, provider availability, and fit for your workload.

Trust this score when

  • There is a fresh timestamped snapshot (or multiple snapshots) for this benchmark.
  • The model list covers the same version family you can actually deploy today.
  • Top candidates overlap with your required routing and feature requirements.

Be cautious when

  • There is only one benchmark snapshot or the dataset appears stale.
  • The benchmark metric direction is opposite of your decision objective.
  • The score difference between options is narrow and likely within implementation variance.

Related benchmarks

Last reviewed: Jun 7, 2026

Resources