LLM ReferenceLLM Reference
Lepton AI API

OpenChat 3.5 (0106) on Lepton AI API

OpenChat 3 · Alignment Lab AI

Serverless

Last refreshed 2026-04-19. Next refresh: weekly.

Why use OpenChat 3.5 (0106) on Lepton AI API?

Lepton AI API offers OpenChat 3.5 (0106) with pay-as-you-go pricing at $0.07/1M input tokens. Lepton AI is building a scalable and efficient AI Application platform.

Compare OpenChat 3.5 (0106) across 4 providers to find the best fit for your use case
Input / 1M
$0.070
Output / 1M
$0.070
Cache
Not sourced
Batch
Not sourced

Setup recipe

Docs fallback
Install
Use the provider REST API or SDK
Auth
Create a provider API key
Call
model: openchat-3.5-0106
Model ID
openchat-3.5-0106

Request example

Curated snippets for this provider are not sourced yet. Use Lepton AI API documentation with model ID openchat-3.5-0106.

Gotchas

No curated gotchas have been sourced for this exact provider/model route yet.

Compare OpenChat 3.5 (0106) Across Providers

ProviderInput (per 1M)Output (per 1M)
Lepton AI API$0.07$0.07
Cloudflare Workers AI
Together AI$0.20$0.20
Fireworks AI$0.20$0.20

Pricing

TypePrice (per 1M)
Input tokens$0.07
Output tokens$0.07

Capabilities

Structured Outputs

About OpenChat 3.5 (0106)

OpenChat 3.5 is an open-source large language model renowned for delivering performance on par with ChatGPT despite having just 7 billion parameters compared to ChatGPT's 70 billion. Built on a transformer architecture, this model uses C-RLFT (Constrained Reinforcement Learning from Trajectories) to learn from mixed-quality data without requiring explicit preference labels. It adeptly handles tasks such as text and code generation, including languages like HTML5 and JavaScript, and excels in multi-turn conversations. OpenChat 3.5 is open-source, making it an appealing choice for developers and researchers, and it is optimized to run efficiently on consumer-grade GPUs with 24GB of RAM. The model also includes specialized modes like "Mathematical Reasoning Mode" for task-specific enhancements. However, it is not without its challenges, as it shares common LLM limitations, such as hallucination and potential safety concerns related to biased or harmful outputs.

FAQ

What does OpenChat 3.5 (0106) cost on Lepton AI API?

On Lepton AI API, OpenChat 3.5 (0106) costs $0.07 per 1M input tokens and $0.07 per 1M output tokens.

What is the context window for OpenChat 3.5 (0106) on Lepton AI API?

OpenChat 3.5 (0106) supports a 8,000 token context window on Lepton AI API.

How does Lepton AI API compare to other OpenChat 3.5 (0106) providers?

OpenChat 3.5 (0106) is available from 4 providers. The cheapest input pricing is $0.07/1M tokens from Lepton AI API.

Who created OpenChat 3.5 (0106)?

OpenChat 3.5 (0106) was created by Alignment Lab AI as part of the OpenChat 3 model family.

Is OpenChat 3.5 (0106) open source?

OpenChat 3.5 (0106)'s open source status is unknown in the seed data.

Get Started

Model Specs

Released2024-01-06
Parameters7B
Context8K
ArchitectureDecoder Only