LLM ReferenceLLM Reference

Arctic

arctic

Deprecated

About

Snowflake Arctic is an advanced large language model tailored for enterprise applications by Snowflake AI Research. It features an innovative Dense-MoE Hybrid transformer architecture, combining a 10 billion parameter dense transformer with a 128 x 3.66 billion parameter MoE MLP, totaling 480 billion parameters but utilizing only 17 billion actively. This structure optimizes efficiency, particularly for tasks like SQL generation, coding, and instruction following. The model's training spanned a diverse dataset of 3.5 trillion tokens, focusing on enterprise needs. Despite its capabilities, Arctic's deployment presents challenges due to its size, and it remains vulnerable to inaccuracies with unclear inputs. Open-sourced under the Apache 2.0 license, it provides comprehensive access to its weights, code, and research findings 1 2 4 5.

Arctic has a 4K-token context window.

Arctic input tokens at $0.65/1M, output at $2.75/1M.

Capabilities

VisionMultimodalReasoningFunction CallingTool UseStructured OutputsCode Execution

Providers(4)

Compare all →
ProviderInput (per 1M)Output (per 1M)Type
NVIDIA NIMProvisioned
Microsoft Foundry$2.00$2.00Provisioned
Together AI$2.4$2.4Serverless
Replicate API$0.65$2.75Serverless

Specifications

FamilyArctic
Released2024-04-24
Parameters480B
Context4K
ArchitectureMixture of Experts
Specializationgeneral
Trainingfinetuned

Created by

Cloud-based data warehousing and analytics.

Bozeman, Montana, United States
Founded 2012
Website