BBQ AmbigactiveSafety
BBQ Ambig
Metric: Bias Score (higher is better)Introduced: 2022
About
Ambiguous context subset of the Bias Benchmark for QA (BBQ), measuring how models respond to social bias questions when context is underspecified.Compare model scores alongside pricing, API availability, and release date — high benchmark score alone doesn't make a model the right pick.
How to read this benchmark
This benchmark uses a scoring system where higher is better. Scores are useful for directional filtering and model shortlisting, not for universal quality ranking.
Interpretation checklist: prefer benchmarks that are closest to your workload style, then validate against the linked model pages for pricing, context window, and provider availability.
Trust when:
- There is a fresh timestamped snapshot (or multiple snapshots) for this benchmark.
- Model list covers the same version family you can actually deploy today.
- Top candidates overlap with your required routing and feature requirements.
Don't trust when:
- There is only one benchmark snapshot or the dataset appears stale.
- Benchmark metric direction is opposite of your decision objective.
- The score difference between options is narrow and likely within implementation variance.
Leaderboard preview (top 5)
No leaderboard entries yet.