CrowS-PairsactiveSafety
CrowS-Pairs
Metric: Bias Score (higher is better)Introduced: 2020
About
1,508 crowdsourced sentence pairs measuring stereotypical bias in masked language models across 9 categories including race, gender, and religion.
1,508 crowdsourced sentence pairs measuring stereotypical bias in masked language models across 9 categories including race, gender, and religion.