Chinchilla 70B
Chinchilla 70B is an early limited-data entry; LLMReference does not yet track enough provider, pricing, benchmark, or task-fit evidence to recommend it.
- Family
- Chinchilla
- Released
- 2022-03-29
- Parameters
- 70B
- Architecture
- Decoder Only
- Specialization
- general
- Openness
- Proprietary
- License
- ProprietaryCommercial use: conditional
- Weights
- Not released
- Code
- Unknown
- Training
- Fine-tuned
No tracked provider pricing is available yet.
About
Chinchilla 70B is a large language model from Google DeepMind, launched in March 2022. It adopts a compute-optimal approach, emphasizing a balance between model size and training data quantity, contrasting previous trends that prioritized model size alone. The model's architecture is based on transformers and utilizes innovations like RMSNorm and relative positional encoding. Trained with the MassiveText dataset using 1.4 trillion tokens, Chinchilla delivers superior performance compared to other larger models like GPT-3. While it demonstrates efficiency in tasks such as reading comprehension and common sense reasoning, limitations include high training costs and the potential for biased outputs.
Providers
No active provider routes are tracked for this model yet.
Capabilities
No model capability flags are currently sourced.
Benchmark peer barsfor Coding
No task-mapped benchmark peers are available for this model yet.
Migration checks
No linked migration route is available for this model yet.
No tracked provider pricing is available yet.