LLM Reference

Zephyr Models by Hugging Face H4

Hugging Face H4MITOpen sourceOpen Source
5 models2023Up to 8k ctxFrom $0.05/1M input

Last refreshed 2026-05-19. Next refresh: weekly.

Details

ResearcherHugging Face H4
LicenseMITOSI-approved
Commercial useCommercial use: permitted
Models5
Released2023
Max context8k

Capabilities

Structured Outputs1 of 5 models

Links

Website

About

The Zephyr family comprises advanced large language models specifically designed to function as highly responsive digital assistants. Notable for their human-like conversational abilities, these models excel in applications involving chatbots and virtual assistant roles. Developed with cutting-edge techniques such as distilled supervised fine-tuning (dSFT), AI feedback (AIF), and distilled direct preference optimization (dDPO), Zephyr models ensure that their output aligns closely with user intent. They often outperform larger models on certain benchmarks, despite being more compact 24. However, in areas requiring complex logic or specialized knowledge, they may face limitations 4. The Zephyr lineup includes iterations like Zephyr-7B-alpha and Zephyr-7B-beta, which is a fine-tuned variant of Mistral-7B 4513. Available through Hugging Face, these models are versatile tools for a range of natural language processing tasks 24.

Decision facts

Best fit
structured outputscodingmath-heavy prompts
Capability starting point
Zephyr ORPO 141B with structured outputs
Lowest tracked input
Zephyr 7B Beta · $0.05/1M · Replicate API
Closest related family
MOSS-Audio

Current Variants

Use-when guidance is based on each model's tracked capabilities, context window, release date, and replacement status.

5 in view

Use when the workload needs 7B parameters.

2023-107B parameters

Use when the workload needs 7B parameters.

2023-107B parameters

Use when the workload needs 7B parameters.

2023-107B parameters

Use when the workload needs 141B parameters and structured outputs.

2023-10141B parametersstructured outputs

Use when the workload needs 8k context and 7B parameters.

2023-108k context7B parameters

Release Timeline

1 release group
2023-10
5 current
Fireworks Zephyr-7B-beta
8k context7B parameters
Current
Zephyr 7B Alpha
7B parameters
Current
Zephyr 7B Beta
7B parameters
Current
Zephyr 7B Gemma
7B parameters
Current
Zephyr ORPO 141B
141B parametersstructured outputs
Current

Specifications(5 models)

Zephyr model specifications comparison
ModelReleasedContextParametersStructured Outputs
Zephyr 7B Alpha2023-107BNo
Zephyr 7B Beta2023-107BNo
Zephyr 7B Gemma2023-107BNo
Zephyr ORPO 141B2023-10141BYes
Fireworks Zephyr-7B-beta2023-108k7BNo

Pricing

Zephyr model pricing by provider
ModelProviderInput / 1MOutput / 1MType
Zephyr 7B BetaReplicate API$0.05$0.25Serverless
Zephyr 7B AlphaReplicate API$0.05$0.25Serverless
Fireworks Zephyr-7B-betaFireworks AI$0.1$0.1Serverless
Zephyr 7B BetaFireworks AI$0.2$0.2Provisioned
Zephyr ORPO 141BDeepInfra$0.65$0.65Serverless