LLM Reference

StarCoder2 3B

Released
2024-07-04
Last refreshed
2026-05-19
Status
Researched 60d ago
Open sourceCommercial use: permitted

StarCoder2 3B is worth evaluating for general LLM work when its provider route and context window match the workload.

Use it for

  • Teams evaluating general LLM work
  • Workloads that can use a 8k context window
  • Buyers comparing 1 tracked provider route

Do not use it for

  • Vision or document-understanding workloads
  • Strict JSON or tool-calling flows
Specifications
Released
2024-07-04
Context
8k
Parameters
3B
Architecture
Decoder Only
Specialization
general
Openness
Open source
License
Apache 2.0OSI-approvedCommercial use: permitted
Weights
Unknown
Code
Unknown
Training
Fine-tuned
Created by

Empowering responsible AI for efficient workflows

Santa Clara, California, United States
Founded 2003
Website
Pricing
Output / 1M
$0.100
Input / 1M
$0.100

Cheapest of 1 route · Fireworks AI

About

StarCoder2-3B is a 3-billion parameter large language model developed by the BigCode project, focusing on code generation tasks. Its architecture features a transformer decoder with grouped-query and sliding window attention, trained using the Fill-in-the-Middle objective. The model supports a context window of 16,384 tokens, allowing it to handle large contexts for tasks like code completion and translation across 17 programming languages. However, it is not designed for direct instruction-following. Its efficiency is enhanced by a Grouped Query Attention mechanism and availability in quantized versions for lower memory usage, though users should note that the generated code may not be error-free 25.

StarCoder2 3B is an open-source model in the StarCoder 2 family. The structured metadata tracks a 8k-token context window. This page tracks provider routes through Fireworks AI, with the cheapest tracked route listed at $0.1 input and $0.1 output per 1M tokens. No headline benchmark score is tracked for StarCoder2 3B yet.

Top use-case fit

No primary decision-task fit is mapped for this model yet.

Provider price ladder

Compare API pricing across 1 providers for input and output tokens, batch, and cached reads when available.

ProviderInput / 1MOutput / 1MRoute
Fireworks AI$0.100$0.100
Provisioned

Available via routers & gateways(1)

Capabilities

No model capability flags are currently sourced.

Benchmark peer barsfor Coding

No task-mapped benchmark peers are available for this model yet.

Migration checks

No linked migration route is available for this model yet.

Frequently asked questions

What is the context window of StarCoder2 3B?

StarCoder2 3B has a context window of 8k tokens.

How much does StarCoder2 3B cost?

StarCoder2 3B is available at $0.10/1M input tokens through Fireworks AI.

When was StarCoder2 3B released?

StarCoder2 3B was released on 2024-07-04.

Which providers offer StarCoder2 3B?

StarCoder2 3B is available from 1 provider: Fireworks AI.