Arctic
About
Snowflake's Arctic family of LLMs is a powerful suite of large language models engineered for enterprise applications, emphasizing both intelligence and resource efficiency. Leading the collection is the Arctic model, which features a unique Mixture-of-Experts (MoE) hybrid transformer architecture. This combines a dense 10B parameter transformer with a 128x3.66B MoE MLP, resulting in an impressive total of 480B parameters, though only 17B are active at any given time. This innovative design allows Arctic to deliver high-quality outcomes while optimizing resource use, outperforming many other prominent open models in various benchmarks. The Arctic lineup also includes models like Arctic-Instruct, tailored for following instructions and generating high-quality responses from natural language queries, and Arctic Embed, a set of text embedding models engineered for retrieval tasks. All models are available under the Apache 2.0 license, fostering open usage and collaboration 12.