Yi 34B
Yi 34B is worth evaluating for coding, rag, and long context when its provider route and context window match the workload.
Use it for
- Teams evaluating coding, rag, and long context
- Workloads that can use a 200k context window
- Buyers comparing 4 tracked provider routes
Do not use it for
- Vision or document-understanding workloads
- Family
- Yi (2023/11)
- Released
- 2023-11-02
- Context
- 200k
- Parameters
- 34B
- Architecture
- Decoder Only
- Knowledge cutoff
- 2024-03
- Specialization
- general
- Training
- finetuned
Cheapest of 5 routes · DeepInfra
About
Yi 34B is 01.AI's Yi (2023/11) model. It offers a 200K-token context window and scores 43 on MMLU PRO.
Yi 34B is 01.AI's 34-billion-parameter bilingual English-Chinese language model. This LLMReference page is aligned to the long-context Yi 34B listing carried in the seed record, with a 200K-token context window, rather than the shorter base card. 01.AI released Yi-34B in November 2023 and also published a Yi-34B-200K extended-context variant for long-document work. The model uses a decoder-only transformer architecture trained independently from scratch; it is similar in shape to Llama-style systems but is not derived from Meta's weights.
The practical reason to consider this row is long bilingual context at a 34B scale. Yi 34B was competitive for its release era on English and Chinese evaluation sets, including a 43 score on MMLU PRO in the current seed data, and it remains useful as a historical baseline for Chinese/English long-context comparisons. It is not the first model to reach for when maximum current reasoning quality matters, but it can still be relevant for teams comparing older open-model deployments or reproducing Yi 1.x results.
Provider coverage is uneven: the seed links Yi 34B to Together AI, Fireworks AI, DeepInfra, Replicate, and Alibaba Cloud, with some listings deprecated or provisioned-only. Treat provider availability and context limits as implementation details to verify before deployment, while this page's model-level summary should be read as the 200K-context Yi 34B entry.
Yi 34B has a 200k-token context window.
Yi 34B input tokens at $0.2/1M, output at $1/1M.
Top use-case fit: coding, agents, and build tasks
Coding
Q/$ B1 relevant benchmark in the decision map.
RAG
Included by capability and metadata signals in the decision map.
Long context
Included by capability and metadata signals in the decision map.
Provider price ladder
Compare all 5Compare API pricing across 4 providers for input and output tokens, batch, and cached reads when available.
| Provider | Input / 1M | Output / 1M | Route |
|---|---|---|---|
| DeepInfra | $0.250 | $0.380 | Serverless |
| Fireworks AI | $0.900 | $0.900 | Provisioned |
| Replicate API | $0.200 | $1.00 | Serverless |
| Alibaba Cloud PAI-EAS | - | - | ServerlessPartial |
Capabilities
Benchmark peer barsfor Coding
Benchmark scores(3)
| Benchmark | Score | Version | Source |
|---|---|---|---|
| HumanEval | 60.0 | pass@1 | https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard |
| Massive Multitask Language Understanding | 73.2 | 5-shot | https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard |
| MMLU PRO | 43.0 | — | https://huggingface.co/spaces/TIGER-Lab/MMLU-Pro |
Migration checks
No linked migration route is available for this model yet.