LLM Reference

Pythia 12B

Released
2023-05-31
Last refreshed
2026-05-19
Status
Researched 60d ago
Open sourceCommercial use: permitted

Pythia 12B is worth evaluating for general LLM work when its provider route and context window match the workload.

Use it for

  • Teams evaluating general LLM work
  • Workloads that can use a 2k context window
  • Buyers comparing 1 tracked provider route

Do not use it for

  • Vision or document-understanding workloads
  • Strict JSON or tool-calling flows
Specifications
Family
Pythia
Released
2023-05-31
Context
2k
Parameters
12B
Architecture
Decoder Only
Knowledge cutoff
2020-03
Specialization
general
Openness
Open source
License
Apache 2.0OSI-approvedCommercial use: permitted
Weights
Unknown
Code
Unknown
Training
Fine-tuned
Created by

Championing open-source AI for everyone

New York, New York, United States
Founded 2020
Website
Pricing
Output / 1M
$0.200
Input / 1M
$0.200

Cheapest of 1 route · Fireworks AI

About

Pythia 12B is EleutherAI's Pythia model. Its knowledge cutoff is 2020-03.

Pythia 12B is an open-source model in the Pythia family. The structured metadata tracks a 2k-token context window. This page tracks provider routes through Fireworks AI, with the cheapest tracked route listed at $0.2 input and $0.2 output per 1M tokens. No headline benchmark score is tracked for Pythia 12B yet.

Top use-case fit

No primary decision-task fit is mapped for this model yet.

Provider price ladder

Compare API pricing across 1 providers for input and output tokens, batch, and cached reads when available.

ProviderInput / 1MOutput / 1MRoute
Fireworks AI$0.200$0.200
Provisioned

Available via routers & gateways(1)

Capabilities

No model capability flags are currently sourced.

Benchmark peer barsfor Coding

No task-mapped benchmark peers are available for this model yet.

Migration checks

No linked migration route is available for this model yet.

Frequently asked questions

What is the context window of Pythia 12B?

Pythia 12B has a context window of 2k tokens.

How much does Pythia 12B cost?

Pythia 12B is available at $0.20/1M input tokens through Fireworks AI.

When was Pythia 12B released?

Pythia 12B was released on 2023-05-31.

Which providers offer Pythia 12B?

Pythia 12B is available from 1 provider: Fireworks AI.