LLM ReferenceLLM Reference
Fireworks AI

OpenChat 3.5 (0106) on Fireworks AI

OpenChat 3 · Alignment Lab AI

Provisioned

Last refreshed 2026-04-19. Next refresh: weekly.

Why use OpenChat 3.5 (0106) on Fireworks AI?

Fireworks AI offers OpenChat 3.5 (0106) with pay-as-you-go pricing at $0.20/1M input tokens. Fireworks AI offers a generative AI platform as a service, focusing on rapid product iteration and cost-efficient AI deployment.

Compare OpenChat 3.5 (0106) across 4 providers to find the best fit for your use case
Input / 1M
$0.20
Output / 1M
$0.20
Cache
Not sourced
Batch
Not sourced

Setup recipe

Python + curl
Install
pip install openai
Auth
export FIREWORKS_API_KEY=...
Call
import os
from openai import OpenAI
client = OpenAI(
    api_key=os.environ["FIREWORKS_API_KEY"],
Model ID
openchat-3.5-0106

Request example

import os
from openai import OpenAI

client = OpenAI(
    api_key=os.environ["FIREWORKS_API_KEY"],
    base_url="https://api.fireworks.ai/inference/v1"
)
response = client.chat.completions.create(
    model="openchat-3.5-0106",
    messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)

Gotchas

  • Fireworks model IDs use "accounts/fireworks/models/{model-name}" format, e.g. "accounts/fireworks/models/llama4-scout-instruct-basic" or "accounts/fireworks/models/deepseek-r1".
  • The examples expect FIREWORKS_API_KEY; rename it only if your application config maps the new variable.

Compare OpenChat 3.5 (0106) Across Providers

ProviderInput (per 1M)Output (per 1M)
Lepton AI API$0.07$0.07
Cloudflare Workers AI
Together AI$0.20$0.20
Fireworks AI$0.20$0.20

Pricing

TypePrice (per 1M)
Input tokens$0.20
Output tokens$0.20

Capabilities

Structured Outputs

About OpenChat 3.5 (0106)

OpenChat 3.5 is an open-source large language model renowned for delivering performance on par with ChatGPT despite having just 7 billion parameters compared to ChatGPT's 70 billion. Built on a transformer architecture, this model uses C-RLFT (Constrained Reinforcement Learning from Trajectories) to learn from mixed-quality data without requiring explicit preference labels. It adeptly handles tasks such as text and code generation, including languages like HTML5 and JavaScript, and excels in multi-turn conversations. OpenChat 3.5 is open-source, making it an appealing choice for developers and researchers, and it is optimized to run efficiently on consumer-grade GPUs with 24GB of RAM. The model also includes specialized modes like "Mathematical Reasoning Mode" for task-specific enhancements. However, it is not without its challenges, as it shares common LLM limitations, such as hallucination and potential safety concerns related to biased or harmful outputs.

FAQ

What does OpenChat 3.5 (0106) cost on Fireworks AI?

On Fireworks AI, OpenChat 3.5 (0106) costs $0.20 per 1M input tokens and $0.20 per 1M output tokens.

What is the context window for OpenChat 3.5 (0106) on Fireworks AI?

OpenChat 3.5 (0106) supports a 8,000 token context window on Fireworks AI.

How does Fireworks AI compare to other OpenChat 3.5 (0106) providers?

OpenChat 3.5 (0106) is available from 4 providers. The cheapest input pricing is $0.07/1M tokens from Lepton AI API.

Who created OpenChat 3.5 (0106)?

OpenChat 3.5 (0106) was created by Alignment Lab AI as part of the OpenChat 3 model family.

Is OpenChat 3.5 (0106) open source?

OpenChat 3.5 (0106)'s open source status is unknown in the seed data.

Get Started

Model Specs

Released2024-01-06
Parameters7B
Context8K
ArchitectureDecoder Only