Llemma 34B
Llemma 34B is released 2023-09-26 in the Llemma family with open-weight; evaluate it while provider pricing coverage matures.
- Family
- Llemma
- Released
- 2023-09-26
- Context
- 4K
- Parameters
- 34B
- Architecture
- Decoder Only
- Knowledge cutoff
- 2023-04
- Specialization
- general
- Openness
- Open weights
- License
- Llama 2 CommunityRestricted
- Weights
- Unknown
- Code
- Unknown
- Training
- Fine-tuned
No tracked provider pricing is available yet.
About
Llemma 34B is a large language model developed by EleutherAI, specifically for mathematical reasoning. It builds on Code Llama architecture and has 34 billion parameters. The model is advanced in solving mathematical problems, leveraging its training on Proof-Pile II, a dataset with 55 billion tokens of mathematical and scientific content. It excels in tool use with Python and theorem provers and showcases strong chain-of-thought reasoning by breaking down complex problems into steps. Despite its capabilities, it faces limitations in generalization outside its training scope and requires substantial computational resources 1.
Providers
No active provider routes are tracked for this model yet.
Capabilities
No model capability flags are currently sourced.
Benchmark peer barsfor Coding
No task-mapped benchmark peers are available for this model yet.
Migration checks
No linked migration route is available for this model yet.
No tracked provider pricing is available yet.