LLM Reference
Fireworks AI

StarCoder on Fireworks AI

StarCoder · ServiceNow Research

ServerlessOpen Source

Last refreshed 2026-05-19. Next refresh: weekly.

Why use StarCoder on Fireworks AI?

Fireworks AI offers StarCoder with pay-as-you-go pricing at $0.20/1M input tokens. Fireworks AI offers a generative AI platform as a service, focusing on rapid product iteration and cost-efficient AI deployment.

Input / 1M
$0.20
Output / 1M
$0.20
Cache
Not sourced
Batch
Not sourced

Setup recipe

Python + curl
Install
pip install openai
Auth
export FIREWORKS_API_KEY=...
Call
import os
from openai import OpenAI
client = OpenAI(
    api_key=os.environ["FIREWORKS_API_KEY"],
Model ID
starcoder

Request example

import os
from openai import OpenAI

client = OpenAI(
    api_key=os.environ["FIREWORKS_API_KEY"],
    base_url="https://api.fireworks.ai/inference/v1"
)
response = client.chat.completions.create(
    model="starcoder",
    messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)

Gotchas

  • Fireworks model IDs use "accounts/fireworks/models/{model-name}" format, e.g. "accounts/fireworks/models/llama4-scout-instruct-basic" or "accounts/fireworks/models/deepseek-r1".
  • The examples expect FIREWORKS_API_KEY; rename it only if your application config maps the new variable.

Pricing

TypePrice (per 1M)
Input tokens$0.20
Output tokens$0.20

Capabilities

No model capability flags are currently sourced.

About StarCoder

StarCoder is a specialized large language model developed for code generation and understanding, as part of a collaboration between Hugging Face and ServiceNow under the BigCode project. It utilizes a decoder-only transformer architecture with multi-query attention and an 8192-token context window. The base model, StarCoderBase, contains 15.5 billion parameters and is trained on 1 trillion tokens sourced from GitHub data, covering various programming languages and use cases. StarCoder is a fine-tuned version that includes an additional 35 billion Python-specific tokens, achieving excellent performance in Python-related tasks. It is multilingual, capable of acting as a technical assistant through dialogue and facilitating code autocompletion, modification, and debugging. Released under the OpenRAIL-M license, the model supports open access and distribution. StarCoder 2 further extends its capabilities, supporting over 600 programming languages and incorporating architectural improvements for enhanced performance.

FAQ

What does StarCoder cost on Fireworks AI?

On Fireworks AI, StarCoder costs $0.2 per 1M input tokens and $0.2 per 1M output tokens.

What is the context window for StarCoder on Fireworks AI?

StarCoder supports a 8,000 token context window on Fireworks AI.

Who created StarCoder?

StarCoder was created by ServiceNow Research as part of the StarCoder model family.

Is StarCoder open source?

StarCoder is open source according to the seed data.

Get Started

Model Specs

Released2023-05-09
Parameters15.5B
Context8K
ArchitectureDecoder Only