BLOOM 176B
BLOOM 176B is released 2022-07-12 in the BLOOM family with open-weight; evaluate it while provider pricing coverage matures.
- Family
- BLOOM
- Released
- 2022-07-12
- Context
- 2k
- Parameters
- 176B
- Architecture
- Decoder Only
- Specialization
- general
- Openness
- Open weights
- License
- BigScience RAIL LicenseCommercial use: conditional
- Weights
- Available
- Code
- Unknown
- Training
- Pretrained
No tracked provider token pricing is available yet.
About
BLOOM 176B is the flagship model of BigScience's BLOOM, a 176-billion-parameter decoder-only language model released in July 2022. More than 1,000 researchers in the BigScience collaboration built it, and it was trained on the Jean Zay public supercomputer in France between March and July 2022. Its training data covers 46 natural languages and 13 programming languages: 1.6TB of pre-processed text, converted into 350B unique tokens. BLOOM continues text from a prompt and uses a 2,048-token sequence length. It is a base model, not instruction-tuned; BigScience's instruction-tuned versions are the BLOOMZ models.
Provider price ladder
No tracked provider token pricing is available for this model yet.
Capabilities
No model capability flags are currently sourced.
Benchmark peer barsfor Coding
No task-mapped benchmark peers are available for this model yet.
Migration checks
No linked migration route is available for this model yet.
API versions
BLOOM 176Bbigscience/bloombloom-176bNo tracked provider token pricing is available yet.