LLM ReferenceLLM Reference

StarCoder2 Models by BigScience

1 model2024Up to 16K ctxFrom $0.2/1M input

About

StarCoder2 is a family of code-focused large language models trained on diverse programming languages.

Specifications(1 models)

StarCoder2 model specifications comparison
ModelReleasedContextParametersStructured Outputs
DeepInfra StarCoder2 15B2024-0716K15BYes

Available From(1 provider)

Pricing

StarCoder2 model pricing by provider
ModelProviderInput / 1MOutput / 1MType
DeepInfra StarCoder2 15BDeepInfra$0.2$0.6Serverless

Frequently Asked Questions

What is StarCoder2 used for?
StarCoder2 is used for structured outputs and coding. The family description and listed model capabilities point to those workloads as the best fit.
How does StarCoder2 compare to MT0?
StarCoder2 by BigScience is strongest where you need structured outputs, while MT0 by BigScience is the closest related family to check for coding. StarCoder2 has 1 listed variant and reaches up to 16K context, so compare the specs and pricing tables before choosing a production model.
Which StarCoder2 model should I use?
For the lowest listed input price, start with DeepInfra StarCoder2 15B through DeepInfra at $0.2/1M input tokens. For the most capable/latest local choice, evaluate DeepInfra StarCoder2 15B with 16K context and structured outputs.

Models(1)