ZAYA1-8B
ZAYA1-8B is a released general LLM work model with open-source; evaluate it while provider pricing coverage matures.
Use it for
- Teams evaluating general LLM work
- Workloads that can use a 33k context window
Do not use it for
- Cost-sensitive launches that need sourced token pricing
- Vision or document-understanding workloads
- Strict JSON or tool-calling flows
- Family
- ZAYA1
- Released
- 2026-05-06
- Context
- 33k
- Parameters
- 8.4B
- Architecture
- Mixture of Experts
- Specialization
- reasoning
- Openness
- Open source
- License
- Apache 2.0OSI-approvedCommercial use: permitted
No tracked provider token pricing is available yet.
About
ZAYA1-8B is a small mixture-of-experts (MoE) reasoning model from Zyphra with 8.4B total parameters and approximately 760M active parameters per token. Trained entirely on AMD Instinct MI300X hardware (1,024 GPUs), it incorporates three architectural innovations: Compressed Convolutional Attention (CCA), a novel MLP-based expert router, and learned residual scaling. Post-training uses a four-stage reinforcement learning cascade covering reasoning warmup, adaptive curriculum, large-scale math/code RL with test-time compute traces, and behavioral RL for instruction following. On extended compute (Markovian RSA), it approaches or exceeds frontier models such as DeepSeek-V3.2 and GPT-OSS-120B on mathematics benchmarks. Released under Apache 2.0 as open weights on Hugging Face and as a free serverless endpoint on Zyphra Cloud.
ZAYA1-8B is an open-source model in the ZAYA1 family. The structured metadata tracks a 33k-token context window and reasoning. No headline benchmark score is tracked for ZAYA1-8B yet.
Top use-case fit
No primary decision-task fit is mapped for this model yet.
Provider price ladder
No tracked provider token pricing is available for this model yet.
Capabilities
Benchmark peer barsfor Coding
No task-mapped benchmark peers are available for this model yet.
Migration checks
No linked migration route is available for this model yet.
No tracked provider token pricing is available yet.