OpenChat 3.5 (0106) on Together AI

OpenChat 3 · Alignment Lab AI

ServerlessOpen Source

Last refreshed 2026-06-15. Next refresh: weekly.

Why use OpenChat 3.5 (0106) on Together AI?

Together AI offers OpenChat 3.5 (0106) with pay-as-you-go pricing at $0.20/1M input tokens. Together AI is a platform for running open-source and proprietary LLMs with fast serverless and dedicated endpoints at competitive inference pricing.

Compare OpenChat 3.5 (0106) across 3 providers to find the best fit for your use case
Input / 1M
$0.20
Output / 1M
$0.20
Cache
Not sourced
Batch
Not sourced

Setup recipe

Python + curl
Install
pip install together
Auth
export TOGETHER_API_KEY=...
Call
from together import Together
client = Together()  # reads TOGETHER_API_KEY from env
response = client.chat.completions.create(
    model="openchat-3.5-0106",
Model ID
openchat-3.5-0106

Request example

from together import Together

client = Together()  # reads TOGETHER_API_KEY from env
response = client.chat.completions.create(
    model="openchat-3.5-0106",
    messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)

Gotchas

  • Together uses "organization/model-name" format, e.g. "meta-llama/Llama-4-Scout-17B-16E-Instruct" or "Qwen/QwQ-32B". See the Together model catalog for the exact ID.
  • The examples expect TOGETHER_API_KEY; rename it only if your application config maps the new variable.

Compare OpenChat 3.5 (0106) Across Providers

ProviderInput (per 1M)Output (per 1M)
Lepton AI API$0.07$0.07
Together AI$0.20$0.20
Fireworks AI$0.20$0.20

Pricing

TypePrice (per 1M)
Input tokens$0.20
Output tokens$0.20

Capabilities

Structured Outputs

About OpenChat 3.5 (0106)

OpenChat 3.5 is an open-source large language model renowned for delivering performance on par with ChatGPT despite having just 7 billion parameters compared to ChatGPT's 70 billion. Built on a transformer architecture, this model uses C-RLFT (Constrained Reinforcement Learning from Trajectories) to learn from mixed-quality data without requiring explicit preference labels. It adeptly handles tasks such as text and code generation, including languages like HTML5 and JavaScript, and excels in multi-turn conversations. OpenChat 3.5 is open-source, making it an appealing choice for developers and researchers, and it is optimized to run efficiently on consumer-grade GPUs with 24GB of RAM.

Get Started

Model Specs

Released2024-01-06
Parameters7B
Context8k
ArchitectureDecoder Only