Pythia 31M
Pythia 31M is released 2023-05-31 in the Pythia family with open-source; evaluate it while provider pricing coverage matures.
- Family
- Pythia
- Released
- 2023-05-31
- Context
- 2K
- Parameters
- 31M
- Architecture
- Decoder Only
- Knowledge cutoff
- 2020-03
- Specialization
- general
- Openness
- Open source
- License
- Apache 2.0OSI-approvedCommercial use: permitted
- Weights
- Unknown
- Code
- Unknown
- Training
- Fine-tuned
No tracked provider pricing is available yet.
About
Pythia 31M is an open-source large language model developed by EleutherAI, designed as part of a suite to explore interpretability, learning dynamics, and ethics in LLMs. This model employs the GPT-NeoXForCausalLM architecture with 30.5 million parameters and a context length of 2048 tokens. Trained from random weights associated with the Pythia series, it has several variants; these versions are based on different datasets such as SimpleWiki, SimplePile Lite, and GoodWiki. The model primarily focuses on text generation, with varying performances across different benchmarks compared to more extensive models like GPT-4.
Providers
No active provider routes are tracked for this model yet.
Capabilities
No model capability flags are currently sourced.
Benchmark peer barsfor Coding
No task-mapped benchmark peers are available for this model yet.
Migration checks
No linked migration route is available for this model yet.
No tracked provider pricing is available yet.