LLM Reference
BBHactiveComposite

BBH: BIG-Bench Hard

Metric: Accuracy (higher is better)Introduced: 2022

23 challenging tasks from BIG-Bench where even large models scored below human performance without chain-of-thought. Tests logical deduction, causal judgment, and formal fallacies.

Models ranked

1

tracked on this benchmark

Score band

83.2 – 83.2

best → lowest tracked

Snapshot trend

need ≥2 snapshots

Leaderboard

Tracked models ranked by Accuracy (higher is better).

Compare candidates
#Model variant and provenanceScore
1
Llama 3 70B
Version: Not recordedHarness: Not recordedEvaluator: Not recordedObserved: May 28, 2026Confidence: Not recordedSource
83.2

How to read this benchmark

This benchmark scores models where higher is better. Use scores for directional filtering and shortlisting, not universal quality ranking; then validate pricing, context window, provider availability, and fit for your workload.

Trust this score when

  • There is a fresh timestamped snapshot (or multiple snapshots) for this benchmark.
  • The model list covers the same version family you can actually deploy today.
  • Top candidates overlap with your required routing and feature requirements.

Be cautious when

  • There is only one benchmark snapshot or the dataset appears stale.
  • The benchmark metric direction is opposite of your decision objective.
  • The score difference between options is narrow and likely within implementation variance.

Related benchmarks

Last reviewed: Apr 15, 2026