Pythia 70M
Pythia 70M is released 2023-05-31 in the Pythia family with open-source; evaluate it while provider pricing coverage matures.
- Family
- Pythia
- Released
- 2023-05-31
- Context
- 2K
- Parameters
- 70M
- Architecture
- Decoder Only
- Knowledge cutoff
- 2020-03
- Specialization
- general
- Openness
- Open source
- License
- Apache 2.0OSI-approvedCommercial use: permitted
- Weights
- Unknown
- Code
- Unknown
- Training
- Fine-tuned
No tracked provider pricing is available yet.
About
The Pythia 70M is a transformer-based large language model developed by EleutherAI, designed for research purposes, particularly in studying the behavior and limitations of large language models. It leverages a similar architecture to other models in the OPT and GPT-Neo suites, and while it's not fine-tuned for specific tasks, it performs comparably to models of similar size. Trained on a diverse English-language dataset called The Pile, Pythia 70M provides insights into model interpretability and evolution with over 154 checkpoints during training.
Providers
No active provider routes are tracked for this model yet.
Capabilities
No model capability flags are currently sourced.
Benchmark peer barsfor Coding
No task-mapped benchmark peers are available for this model yet.
Migration checks
No linked migration route is available for this model yet.
No tracked provider pricing is available yet.