LLM ReferenceLLM Reference
NVIDIA NIM

Arctic on NVIDIA NIM

Arctic · Snowflake

Provisioned

Last refreshed 2026-05-01. Next refresh: weekly.

Why use Arctic on NVIDIA NIM?

NVIDIA NIM offers Arctic with competitive pricing. NVIDIA NIM is NVIDIA's deployment platform for GPU-accelerated inference microservices.

Compare Arctic across 4 providers to find the best fit for your use case
Input / 1M
-
Output / 1M
-
Cache
Not sourced
Batch
Not sourced

Setup recipe

Docs fallback
Install
Use the provider REST API or SDK
Auth
Create a provider API key
Call
model: arctic
Model ID
arctic

Request example

Curated snippets for this provider are not sourced yet. Use NVIDIA NIM documentation with model ID arctic.

Gotchas

No curated gotchas have been sourced for this exact provider/model route yet.

Compare Arctic Across Providers

ProviderInput (per 1M)Output (per 1M)
NVIDIA NIM
Microsoft Foundry$2.00$2.00
Together AI$2.40$2.40
Replicate API$0.65$2.75

Pricing

TypeRate
GPU Hour Rate$1.00/GPU·hr

Capabilities

Structured Outputs

About Arctic

Snowflake Arctic is an advanced large language model tailored for enterprise applications by Snowflake AI Research. It features an innovative Dense-MoE Hybrid transformer architecture, combining a 10 billion parameter dense transformer with a 128 x 3.66 billion parameter MoE MLP, totaling 480 billion parameters but utilizing only 17 billion actively. This structure optimizes efficiency, particularly for tasks like SQL generation, coding, and instruction following. The model's training spanned a diverse dataset of 3.5 trillion tokens, focusing on enterprise needs. Despite its capabilities, Arctic's deployment presents challenges due to its size, and it remains vulnerable to inaccuracies with unclear inputs. Open-sourced under the Apache 2.0 license, it provides comprehensive access to its weights, code, and research findings 1 2 4 5.

FAQ

What is the context window for Arctic on NVIDIA NIM?

Arctic supports a 4,000 token context window on NVIDIA NIM.

How does NVIDIA NIM compare to other Arctic providers?

Arctic is available from 4 providers. The cheapest input pricing is $0.65/1M tokens from Replicate API.

Who created Arctic?

Arctic was created by Snowflake as part of the Arctic model family.

Is Arctic open source?

Arctic's open source status is unknown in the seed data.

Get Started

Model Specs

Released2024-04-24
Parameters480B
Context4K
ArchitectureMixture of Experts