activeAgents

WebVoyager

Metric: Accuracy (higher is better)Introduced: 2024

Web navigation benchmark for evaluating browser agents on real-world websites and multi-step web tasks.

Models ranked

tracked on this benchmark

Score band

92.2 – 80.5

best → lowest tracked

Snapshot trend

+5.90

Nov 13 → Oct 17 · 1 models

Leaderboard

Tracked models ranked by Accuracy (higher is better).

Compare candidates

#Model variant and provenanceRelative to leaderScore

Holo1-7B

Version: WebVoyager - with Surfer-H agentHarness: Not recordedEvaluator: Not recordedObserved: Jun 3, 2025Confidence: Not recordedSource

Notes: H Company (self-reported); medium confidence; yes.

92.2

Holo1-3B

Version: WebVoyager - with Surfer-H agentHarness: Not recordedEvaluator: Not recordedObserved: Jun 3, 2025Confidence: Not recordedSource

Notes: H Company (self-reported); medium confidence; yes - public benchmark, standard task, self-reported at launch.

89.7

Gemini 2.5 Pro Computer Use Preview

Configuration: Gemini 2.5 Computer Use (self-reported)

Version: WebVoyager, 559 date-edited tasks (self-reported, official leaderboard)Harness: Gemini Computer Use API reference implementation; Anchor browser env; human judgingEvaluator: Google DeepMindObserved: Oct 17, 2026Confidence: self-reportedSource

Notes: Model card table (Gemini 2.5 Computer Use, 10-2025) + additional-info PDF https://storage.googleapis.com/deepmind-media/gemini/computer_use_eval_additional_info.pdf (published 2025-10-07). Self-reported: 559 of 643 tasks remaining after date edits/removal of infeasible tasks; Anchor environment, API reference implementation defaults (temperature=1), pass@1, majority vote of 3 human judges. Card warns self-reported WebVoyager results are hard to compare across labs. Same card also reports 79.9% measured by Browserbase on its harness (identical across APIs, same query set/websites/day, human evaluation). Retrieved 2026-10-17.

88.9

Holo2-30B-A3B

Version: WebVoyager - navigation agentHarness: Not recordedEvaluator: Not recordedObserved: Nov 13, 2025Confidence: Not recordedSource

Notes: H Company (self-reported); medium confidence; yes.

83.0

Holotron-12B

Version: WebVoyager - navigation agentHarness: Not recordedEvaluator: Not recordedObserved: Mar 16, 2026Confidence: Not recordedSource

Notes: H Company (self-reported); medium confidence; yes.

80.5

How to read this benchmark

This benchmark scores models where higher is better. Use scores for directional filtering and shortlisting, not universal quality ranking; then validate pricing, context window, provider availability, and fit for your workload.

Trust this score when

There is a fresh timestamped snapshot (or multiple snapshots) for this benchmark.
The model list covers the same version family you can actually deploy today.
Top candidates overlap with your required routing and feature requirements.

Be cautious when

There is only one benchmark snapshot or the dataset appears stale.
The benchmark metric direction is opposite of your decision objective.
The score difference between options is narrow and likely within implementation variance.

Related benchmarks

AA Coding Agent Index

Artificial Analysis Coding Agent Index

Berkeley Function Calling Leaderboard v3

Last reviewed: Jun 7, 2026

Resources

Website