Llemma 34B
Llemma 34B is released 2023-09-26 in the Llemma family with open-weight; evaluate it while provider pricing coverage matures.
Use it for
- Teams evaluating general LLM work
- Workloads that can use a 4k context window
Do not use it for
- Cost-sensitive launches that need sourced token pricing
- Vision or document-understanding workloads
- Strict JSON or tool-calling flows
- Family
- Llemma
- Released
- 2023-09-26
- Context
- 4k
- Parameters
- 34B
- Architecture
- Decoder Only
- Knowledge cutoff
- 2023-04
- Specialization
- general
- Openness
- Open weights
- License
- Llama 2 CommunityCommercial use: conditional
- Weights
- Unknown
- Code
- Unknown
- Training
- Fine-tuned
No tracked provider token pricing is available yet.
About
Llemma 34B is a large language model developed by EleutherAI, specifically for mathematical reasoning. It builds on Code Llama architecture and has 34 billion parameters. The model is advanced in solving mathematical problems, leveraging its training on Proof-Pile II, a dataset with 55 billion tokens of mathematical and scientific content. It excels in tool use with Python and theorem provers and showcases strong chain-of-thought reasoning by breaking down complex problems into steps. Despite its capabilities, it faces limitations in generalization outside its training scope and requires substantial computational resources 1.
Llemma 34B is an open-weight model in the Llemma family. The structured metadata tracks a 4k-token context window. No headline benchmark score is tracked for Llemma 34B yet.
Top use-case fit
No primary decision-task fit is mapped for this model yet.
Provider price ladder
No tracked provider token pricing is available for this model yet.
Capabilities
No model capability flags are currently sourced.
Benchmark peer barsfor Coding
No task-mapped benchmark peers are available for this model yet.
Migration checks
No linked migration route is available for this model yet.
Frequently asked questions
What is the context window of Llemma 34B?
Llemma 34B has a context window of 4k tokens.
When was Llemma 34B released?
Llemma 34B was released on 2023-09-26.
No tracked provider token pricing is available yet.