StarCoder Models by ServiceNow Research
About
StarCoder is a family of open-source large language models (LLMs) that excel in code generation and manipulation. Developed through a collaboration between Hugging Face and ServiceNow, these models are trained on an extensive dataset comprising over 80 programming languages, Git commits, GitHub issues, and Jupyter notebooks, sourced from permissively licensed code on GitHub. The flagship StarCoder model features 15.5 billion parameters, leveraging 1 trillion tokens for its training, while the foundational StarCoderBase offers a more generalized application. Beyond mere code completion, StarCoder can modify code according to instructions, explain snippets in natural language, and function as a technical assistant. Released under the BigCode OpenRAIL-M v1 license, these models are accessible for both research and commercial purposes. A later version, StarCoder2, brings enhanced performance and increased size 147.
Current Variants
Use-when guidance is derived from seed capabilities, context, release, and replacement fields.
Use when the workload needs 8k context and 15.5B parameters.
Use when the workload needs 8k context and 15.5B parameters.
| Model | Use when | Released | Signals | Status |
|---|---|---|---|---|
| StarCoder | Use when the workload needs 8k context and 15.5B parameters. | 2023-05 | 8k context15.5B parameters | Current |
| StarCoder+ | Use when the workload needs 8k context and 15.5B parameters. | 2023-05 | 8k context15.5B parameters | Current |
Release Timeline
1 release groupSpecifications(2 models)
| Model | Released | Context | Parameters |
|---|---|---|---|
| StarCoder | 2023-05 | 8k | 15.5B |
| StarCoder+ | 2023-05 | 8k | 15.5B |
Available From(1 provider)
Pricing
| Model | Provider | Input / 1M | Output / 1M | Type |
|---|---|---|---|---|
| StarCoder | Fireworks AI | $0.2 | $0.2 | Serverless |
Frequently Asked Questions
- What is StarCoder used for?
- StarCoder is used for coding. The family description and listed model capabilities point to those workloads as the best fit.
- How does StarCoder compare to StarCoder 2?
- StarCoder by ServiceNow Research is strongest where you need coding, while StarCoder 2 by ServiceNow Research is the closest related family to check for coding. StarCoder has 2 listed variants and reaches up to 8k context, while StarCoder 2 reaches up to 16k context, so compare the specs and pricing tables before choosing a production model.
