StableLM
About
The StableLM family, developed by Stability AI, offers a suite of open-source large language models (LLMs) designed for both power and efficiency. Initially released with models containing 3 billion and 7 billion parameters, the suite has expanded to include larger models like the 12 billion parameter StableLM 2, as well as smaller variants like the 1.6 billion parameter StableLM 2. These models are trained on enormous datasets, with the first models utilizing a dataset three times larger than The Pile, comprising 1.5 trillion content tokens. Capable of generating text and code, StableLM models are licensed under the CC BY-SA-4.0 license for commercial and research use, although some exceptions apply for fine-tuned versions. Emphasizing accessibility, the open-source nature of StableLM seeks to democratize advanced AI technology 125.