Pythia 14M
Pythia 14M is released 2023-05-31 in the Pythia family with open-source; evaluate it while provider pricing coverage matures.
- Family
- Pythia
- Released
- 2023-05-31
- Context
- 2K
- Parameters
- 14M
- Architecture
- Decoder Only
- Knowledge cutoff
- 2020-03
- Specialization
- general
- Openness
- Open source
- License
- Apache 2.0OSI-approvedPermitted
- Weights
- Unknown
- Code
- Unknown
- Training
- Fine-tuned
No tracked provider pricing is available yet.
About
Pythia 14M is a large language model developed by EleutherAI, utilizing the GPT-NeoX architecture. It consists of 14 million parameters and can handle a context length of up to 2048 tokens, which allows it to be efficiently used with just 0.1 GB of VRAM. Designed for generating English text, this model excels at tasks such as sentence generation and completion. However, Pythia 14M is not ideal for tasks that require extensive domain knowledge or involve non-English text due to its smaller size, which can impact performance in comparison to larger models.
Providers
No active provider routes are tracked for this model yet.
Capabilities
No model capability flags are currently sourced.
Benchmark peer barsfor Coding
No task-mapped benchmark peers are available for this model yet.
Migration checks
No linked migration route is available for this model yet.
No tracked provider pricing is available yet.