Smaug Models by Abacus.AI
Last refreshed 2026-05-19. Next refresh: weekly.
Details
About
The Smaug large language model family by Abacus AI stands out for its exceptional performance in reasoning and mathematics. As open-source models, they are built on the foundation of Qwen-72B, enhanced through innovative fine-tuning techniques like DPO-Positive (DPOP), which tackles standard DPO loss limitations, especially in datasets with minimal differences between completion pairs. This advancement is documented in a research paper on arXiv. The Smaug-72B model has notably topped the Hugging Face Open LLM leaderboard, earning the distinction of being the first open-source model to score above 80 on average across key evaluations. These Smaug models are readily accessible on Hugging Face, fostering easy utilization and modification for the AI community at large 349.
Decision facts
Current Variants
Use-when guidance is based on each model's tracked capabilities, context window, release date, and replacement status.
Use when the workload needs 32k context and 72B parameters.
Use when the workload needs 200k context and 34B parameters.
| Model | Use when | Released | Signals | Status |
|---|---|---|---|---|
| Smaug 72B | Use when the workload needs 32k context and 72B parameters. | 2023-12 | 32k context72B parameters | Current |
| Smaug 34B | Use when the workload needs 200k context and 34B parameters. | 2023-12 | 200k context34B parameters | Current |
Release Timeline
1 release groupSpecifications(2 models)
Available From(1 provider)
Pricing
| Model | Provider | Input / 1M | Output / 1M | Type |
|---|---|---|---|---|
| Smaug 72B | Microsoft Foundry | $1 | $2 | Provisioned |
