LLM ReferenceLLM Reference

StarCoder

ServiceNow ResearchCoding
2 models2023Up to 8K ctxFrom $0.2/1M input

About

StarCoder is a family of open-source large language models (LLMs) that excel in code generation and manipulation. Developed through a collaboration between Hugging Face and ServiceNow, these models are trained on an extensive dataset comprising over 80 programming languages, Git commits, GitHub issues, and Jupyter notebooks, sourced from permissively licensed code on GitHub. The flagship StarCoder model features 15.5 billion parameters, leveraging 1 trillion tokens for its training, while the foundational StarCoderBase offers a more generalized application. Beyond mere code completion, StarCoder can modify code according to instructions, explain snippets in natural language, and function as a technical assistant. Released under the BigCode OpenRAIL-M v1 license, these models are accessible for both research and commercial purposes. A later version, StarCoder2, brings enhanced performance and increased size 147.

Specifications(2 models)

StarCoder model specifications comparison
ModelReleasedContextParameters
StarCoder2023-058K15.5B
StarCoder+2023-058K15.5B

Available From(1 provider)

Fireworks AI

Pricing

StarCoder model pricing by provider
ModelProviderInput / 1MOutput / 1MType
StarCoderFireworks AI$0.2$0.2Serverless

Frequently Asked Questions

What is StarCoder?
StarCoder is a family of open-source large language models (LLMs) that excel in code generation and manipulation. Developed through a collaboration between Hugging Face and ServiceNow, these models are trained on an extensive dataset comprising over 80 programming languages, Git commits, GitHub issues, and Jupyter notebooks, sourced from permissively licensed code on GitHub. The flagship StarCoder model features 15.5 billion parameters, leveraging 1 trillion tokens for its training, while the foundational StarCoderBase offers a more generalized application. Beyond mere code completion, StarCoder can modify code according to instructions, explain snippets in natural language, and function as a technical assistant. Released under the BigCode OpenRAIL-M v1 license, these models are accessible for both research and commercial purposes. A later version, StarCoder2, brings enhanced performance and increased size 147.
How many models are in the StarCoder family?
The StarCoder family contains 2 models.
What is the latest StarCoder model?
The latest model is StarCoder, released in 2023-05.
How much does StarCoder cost?
StarCoder models are available at $0.2/1M input tokens through providers like Fireworks AI.

Models(2)

StarCoder

2023-058K15.5B1 provider
Open Source

StarCoder+

2023-058K15.5B
Open Source