StarCoder2 7B
StarCoder2 7B is worth evaluating for general LLM work when its provider route and context window match the workload.
Use it for
- Teams evaluating general LLM work
- Workloads that can use a 8k context window
- Buyers comparing 2 tracked provider routes
Do not use it for
- Vision or document-understanding workloads
- Strict JSON or tool-calling flows
- Family
- StarCoder 2
- Released
- 2024-07-04
- Context
- 8k
- Parameters
- 7B
- Architecture
- Decoder Only
- Specialization
- general
- Training
- finetuned
Empowering responsible AI for efficient workflows
Cheapest of 2 routes · Fireworks AI
About
The StarCoder2 7B model is a large language model engineered for code generation tasks, containing 7 billion parameters. It is trained on a vast dataset of 3.5 trillion tokens known as The Stack v2, which includes diverse code samples from 17 programming languages such as Python, Java, and JavaScript. This model features Grouped Query Attention with a significant context window of 16,384 tokens and a sliding window attention of 4,096 tokens, enabling it to adeptly manage complex coding tasks. StarCoder2 7B excels in code completion, summarization, and generating code snippets from given prompts. It is built with responsible data usage in mind, designed to avoid directly copying copyrighted code, making it a reliable tool for developers 124.
StarCoder2 7B is an open-source model in the StarCoder 2 family. The structured metadata tracks a 8k-token context window. This page tracks provider routes through Fireworks AI and NVIDIA NIM, with the cheapest tracked route listed at $0.2 input and $0.2 output per 1M tokens. No headline benchmark score is tracked for StarCoder2 7B yet.
Top use-case fit
No primary decision-task fit is mapped for this model yet.
Provider price ladder
Compare all 2Compare API pricing across 2 providers for input and output tokens, batch, and cached reads when available.
| Provider | Input / 1M | Output / 1M | Route |
|---|---|---|---|
| Fireworks AI | $0.200 | $0.200 | ServerlessProvisioned |
| NVIDIA NIM | - | - | ProvisionedPartial |
Capabilities
No model capability flags are currently sourced.
Benchmark peer barsfor Coding
No task-mapped benchmark peers are available for this model yet.
Migration checks
No linked migration route is available for this model yet.