StarCoder2 3B
StarCoder2 3B is worth evaluating for general LLM work when its provider route and context window match the workload.
Use it for
- Teams evaluating general LLM work
- Workloads that can use a 8k context window
- Buyers comparing 1 tracked provider route
Do not use it for
- Vision or document-understanding workloads
- Strict JSON or tool-calling flows
- Family
- StarCoder 2
- Released
- 2024-07-04
- Context
- 8k
- Parameters
- 3B
- Architecture
- Decoder Only
- Specialization
- general
- Openness
- Open source
- License
- Apache 2.0OSI-approvedCommercial use: permitted
- Weights
- Unknown
- Code
- Unknown
- Training
- Fine-tuned
Empowering responsible AI for efficient workflows
Cheapest of 1 route · Fireworks AI
About
StarCoder2-3B is a 3-billion parameter large language model developed by the BigCode project, focusing on code generation tasks. Its architecture features a transformer decoder with grouped-query and sliding window attention, trained using the Fill-in-the-Middle objective. The model supports a context window of 16,384 tokens, allowing it to handle large contexts for tasks like code completion and translation across 17 programming languages. However, it is not designed for direct instruction-following. Its efficiency is enhanced by a Grouped Query Attention mechanism and availability in quantized versions for lower memory usage, though users should note that the generated code may not be error-free 25.
StarCoder2 3B is an open-source model in the StarCoder 2 family. The structured metadata tracks a 8k-token context window. This page tracks provider routes through Fireworks AI, with the cheapest tracked route listed at $0.1 input and $0.1 output per 1M tokens. No headline benchmark score is tracked for StarCoder2 3B yet.
Top use-case fit
No primary decision-task fit is mapped for this model yet.
Provider price ladder
Compare API pricing across 1 providers for input and output tokens, batch, and cached reads when available.
| Provider | Input / 1M | Output / 1M | Route |
|---|---|---|---|
| Fireworks AI | $0.100 | $0.100 | Provisioned |
Available via routers & gateways(1)
Capabilities
No model capability flags are currently sourced.
Benchmark peer barsfor Coding
No task-mapped benchmark peers are available for this model yet.
Migration checks
No linked migration route is available for this model yet.
Frequently asked questions
What is the context window of StarCoder2 3B?
StarCoder2 3B has a context window of 8k tokens.
How much does StarCoder2 3B cost?
StarCoder2 3B is available at $0.10/1M input tokens through Fireworks AI.
When was StarCoder2 3B released?
StarCoder2 3B was released on 2024-07-04.
Which providers offer StarCoder2 3B?
StarCoder2 3B is available from 1 provider: Fireworks AI.
Empowering responsible AI for efficient workflows
Cheapest of 1 route · Fireworks AI