LLM ReferenceLLM Reference
Replicate API

Granite 3.3 8B Instruct on Replicate API

Granite 3 · IBM Research

ServerlessOpen Source

Last refreshed 2026-04-15. Next refresh: weekly.

Why use Granite 3.3 8B Instruct on Replicate API?

Replicate API offers Granite 3.3 8B Instruct with pay-as-you-go pricing at $0.03/1M input tokens. Replicate is a cloud-based platform that enables users to run machine learning models easily and efficiently.

Compare Granite 3.3 8B Instruct across 2 providers to find the best fit for your use case
Input / 1M
$0.030
Output / 1M
$0.25
Cache
Not sourced
Batch
Not sourced

Setup recipe

Python + curl
Install
pip install replicate
Auth
export REPLICATE_API_TOKEN=...
Call
import replicate
output = replicate.run(
    "granite-3.3-8b-instruct",
    input={"prompt": "Hello"}
Model ID
granite-3.3-8b-instruct

Request example

import replicate

# reads REPLICATE_API_TOKEN from env
# granite-3.3-8b-instruct format: "owner/model-name" (latest version) or "owner/model-name:version-hash"
output = replicate.run(
    "granite-3.3-8b-instruct",
    input={"prompt": "Hello"}
)
# Output is a list or generator depending on the model
print("".join(output))

Gotchas

  • Replicate uses "owner/model-name" format (e.g. "meta/meta-llama-3-8b-instruct") for the latest version, or "owner/model-name:version-sha" to pin to a specific version. The REST endpoint splits owner and model-name into the path: /v1/models/{owner}/{model-name}/predictions.
  • The examples expect REPLICATE_API_TOKEN; rename it only if your application config maps the new variable.

Compare Granite 3.3 8B Instruct Across Providers

ProviderInput (per 1M)Output (per 1M)
NVIDIA NIM
Replicate API$0.03$0.25

Pricing

TypePrice (per 1M)
Input tokens$0.03
Output tokens$0.25

Capabilities

Function CallingTool Use

About Granite 3.3 8B Instruct

IBM Granite 3.3 8B with improved reasoning capabilities. Part of IBM's enterprise-focused Granite model family optimized for instruction following.

FAQ

What does Granite 3.3 8B Instruct cost on Replicate API?

On Replicate API, Granite 3.3 8B Instruct costs $0.03 per 1M input tokens and $0.25 per 1M output tokens.

What is the context window for Granite 3.3 8B Instruct on Replicate API?

Granite 3.3 8B Instruct supports a 128,000 token context window on Replicate API.

How does Replicate API compare to other Granite 3.3 8B Instruct providers?

Granite 3.3 8B Instruct is available from 2 providers. The cheapest input pricing is $0.03/1M tokens from Replicate API.

Who created Granite 3.3 8B Instruct?

Granite 3.3 8B Instruct was created by IBM Research as part of the Granite 3 model family.

Is Granite 3.3 8B Instruct open source?

Granite 3.3 8B Instruct is open source according to the seed data.

Get Started

Model Specs

Released2025-03-01
Parameters8B
Context128K
ArchitectureDecoder Only

GPU-Hour Providers(1)