Gopher 280B
Gopher 280B is an early limited-data entry; LLMReference does not yet track enough provider, pricing, benchmark, or task-fit evidence to recommend it.
- Family
- Chinchilla
- Released
- 2022-03-29
- Parameters
- 280B
- Architecture
- Decoder Only
- Specialization
- general
- Openness
- Proprietary
- License
- ProprietaryRestricted
- Weights
- Not released
- Code
- Unknown
- Training
- Fine-tuned
No tracked provider pricing is available yet.
About
Gopher 280B, developed by DeepMind, is a significant advancement in the field of natural language processing, featuring an impressive 280 billion parameters. This model surpasses OpenAI's GPT-3 in size while employing a Transformer-based architecture with modifications like RMSNorm and relative positional encoding to enhance performance on longer text sequences. Trained on a massive 10.5 TB dataset, Gopher excels in various NLP tasks such as reading comprehension and toxic language detection but faces challenges in logical reasoning tasks.
Providers
No active provider routes are tracked for this model yet.
Capabilities
No model capability flags are currently sourced.
Benchmark peer barsfor Coding
No task-mapped benchmark peers are available for this model yet.
Migration checks
No linked migration route is available for this model yet.
No tracked provider pricing is available yet.