Using StarCoder2 15B on NVIDIA NIM

Implementation guide · StarCoder 2 · ServiceNow Research

ProvisionedOpen Source

NVIDIA NIM exposes StarCoder2 15B through model ID starcoder2-15b. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.

Last refreshed 2026-05-01. Next refresh: weekly.

Quick Start

  1. 1
    Create an account at NVIDIA NIM and generate an API key.
  2. 2
    Use the NVIDIA NIM SDK or REST API to call starcoder2-15b — see the documentation for request format.
  3. 3
    You'll be billed . See full pricing.
API PortalDocumentationPricingModel Card

Code Examples

See NVIDIA NIM documentation for integration details.

Pricing on NVIDIA NIM

Capabilities

Structured Outputs

About StarCoder2 15B

StarCoder2-15B is a sophisticated large language model, expertly crafted for code generation and understanding. Developed by the BigCode project, it features 15 billion parameters and is trained on The Stack v2, a vast dataset of over 4 trillion tokens from more than 600 programming languages. Its advanced transformer decoder architecture, equipped with a grouped-query and sliding window attention mechanism and a Fill-in-the-Middle training objective, allows a context window of 16,384 tokens. In addition to generating and completing code, the model excels in tasks like code summarization and retrieving relevant snippets through natural language queries.

Full model details →

Model Specs

Released2024-07-04
Parameters15B
Context8k
ArchitectureDecoder Only

More Models on NVIDIA NIM

StarCoder2 7B
All models on NVIDIA NIM →

Also available on(2)

Fireworks AI$0.20/1MDeepInfra$0.20/1M
Compare all providers →

Provider

NVIDIA NIM

NVIDIA

Santa Clara, California, United States