Last refreshed 2026-04-24. Next refresh: weekly.
Why use OpenChat 3.6 8B on DeepInfra?
DeepInfra offers OpenChat 3.6 8B with pay-as-you-go pricing at $0.05/1M input tokens. DeepInfra is a cloud inference platform offering cost-effective access to open-source AI models.
Setup recipe
Python + curlpip install openaiexport DEEPINFRA_API_KEY=...import os
from openai import OpenAI
client = OpenAI(
api_key=os.environ["DEEPINFRA_API_KEY"],openchat-3.6-8bRequest example
import os
from openai import OpenAI
client = OpenAI(
api_key=os.environ["DEEPINFRA_API_KEY"],
base_url="https://api.deepinfra.com/v1/openai"
)
response = client.chat.completions.create(
model="openchat-3.6-8b",
messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)Gotchas
- DeepInfra uses "organization/model-name" format, e.g. "meta-llama/Meta-Llama-3-8B-Instruct" or "mistralai/Mistral-7B-Instruct-v0.3". See the DeepInfra model catalog for exact IDs.
- The examples expect DEEPINFRA_API_KEY; rename it only if your application config maps the new variable.
Pricing
| Type | Price (per 1M) |
|---|---|
| Input tokens | $0.05 |
| Output tokens | $0.15 |
Capabilities
About OpenChat 3.6 8B
OpenChat 3.6 8B is an open-source LLM built on the Llama 3 architecture, fine-tuned with offline reinforcement learning techniques to outperform other models like Llama 3 8B Instruct. Known for its competence in general conversation, coding support, and mathematical reasoning, it does face limitations with complex reasoning and occasionally generating inaccurate information. The model's deployment is optimized for consumer GPUs with 24GB RAM, supporting tensor parallelism for enhanced processing speed. It is accessible on platforms like Hugging Face, facilitating experimentation and usage.
FAQ
What does OpenChat 3.6 8B cost on DeepInfra?
On DeepInfra, OpenChat 3.6 8B costs $0.05 per 1M input tokens and $0.15 per 1M output tokens.
What is the context window for OpenChat 3.6 8B on DeepInfra?
OpenChat 3.6 8B supports a 8,000 token context window on DeepInfra.
Who created OpenChat 3.6 8B?
OpenChat 3.6 8B was created by Alignment Lab AI as part of the OpenChat 3 model family.
Is OpenChat 3.6 8B open source?
OpenChat 3.6 8B's open source status is unknown in the seed data.