Zephyr ORPO 141B

Released
2023-10-26
Last refreshed
2026-04-19
Status
Researched 181d ago
Open sourceCommercial use: permittedClassificationJSON / Tool use
Specifications
Family
Zephyr
Released
2023-10-26
Parameters
141B
Architecture
Decoder Only
Knowledge cutoff
2024-01
Specialization
general
Openness
Open source
License
MITOSI-approvedPermitted
Weights
Unknown
Code
Unknown
Training
Fine-tuned
Created by

Community-driven open-source AI model hub

New York City, New York, United States
Founded 2016
Website
Pricing

No tracked provider pricing is available yet.

About

The Zephyr ORPO 141B is a cutting-edge large language model by Hugging Face, developed in partnership with Argilla and KAIST. It employs a Mixture of Experts (MoE) architecture, consisting of 141 billion parameters, with 39 billion active during operation. The model is derived from the Mixtral-8x22B framework and fine-tuned using the innovative Odds Ratio Preference Optimization (ORPO) method, which improves computational efficiency by removing the need for a separate supervised fine-tuning phase.

Providers

No active provider routes are tracked for this model yet.

Deprecated provider routes(1)

ProviderStatusCatalog ID
DeepInfraDeprecated—

Capabilities

Structured Outputs

Benchmark peer barsfor Classification

No task-mapped benchmark peers are available for this model yet.

Migration checks

No linked migration route is available for this model yet.