LLM Reference
NaturalQactive

NaturalQ: Natural Questions

Metric: Exact Match / F1 (higher is better)Introduced: 2019

307,373 real Google search queries answered by extracting spans from Wikipedia, with short answer, long answer, and no-answer categories.

Models ranked

0

tracked on this benchmark

Score band

no scores yet

Snapshot trend

need ≥2 snapshots

Leaderboard

Tracked models ranked by Exact Match / F1 (higher is better).

Compare candidates

No leaderboard entries are tracked for this benchmark yet.

How to read this benchmark

This benchmark scores models where higher is better. Use scores for directional filtering and shortlisting, not universal quality ranking; then validate pricing, context window, provider availability, and fit for your workload.

Trust this score when

  • There is a fresh timestamped snapshot (or multiple snapshots) for this benchmark.
  • The model list covers the same version family you can actually deploy today.
  • Top candidates overlap with your required routing and feature requirements.

Be cautious when

  • There is only one benchmark snapshot or the dataset appears stale.
  • The benchmark metric direction is opposite of your decision objective.
  • The score difference between options is narrow and likely within implementation variance.

Last reviewed: Apr 15, 2026