LLM Reference

Llemma 34B

Released
2023-09-26
Last refreshed
2026-05-19
Status
Researched 16d ago

Llemma 34B has model metadata, but missing tracked provider pricing keeps it from being a default production pick.

Use it for

  • Teams evaluating general LLM work
  • Workloads that can use a 4k context window

Do not use it for

  • Cost-sensitive launches that need sourced token pricing
  • Vision or document-understanding workloads
  • Strict JSON or tool-calling flows
Specifications
Family
Llemma
Released
2023-09-26
Context
4k
Parameters
34B
Architecture
Decoder Only
Knowledge cutoff
2023-04
Specialization
general
Training
finetuned
Created by

Championing open-source AI for everyone

New York, New York, United States
Founded 2020
Website
Pricing

No tracked provider token pricing is available yet.

About

Llemma 34B is a large language model developed by EleutherAI, specifically for mathematical reasoning. It builds on Code Llama architecture and has 34 billion parameters. The model is advanced in solving mathematical problems, leveraging its training on Proof-Pile II, a dataset with 55 billion tokens of mathematical and scientific content. It excels in tool use with Python and theorem provers and showcases strong chain-of-thought reasoning by breaking down complex problems into steps. Despite its capabilities, it faces limitations in generalization outside its training scope and requires substantial computational resources 1.

Llemma 34B is a model in the Llemma family. The structured metadata tracks a 4k-token context window. No headline benchmark score is tracked for Llemma 34B yet.

Top use-case fit

No primary decision-task fit is mapped for this model yet.

Provider price ladder

No tracked provider token pricing is available for this model yet.

Capabilities

No model capability flags are currently sourced.

Benchmark peer barsfor Coding

No task-mapped benchmark peers are available for this model yet.

Migration checks

No linked migration route is available for this model yet.

Rankings & picks(4)