LLM ReferenceLLM Reference

OpenChat 3

Alignment Lab AIApache 2.0Open Source
7 models2023–2024Up to 8K ctxFrom $0.05/1M input

About

The OpenChat 3 family consists of open-source large language models (LLMs) that are fine-tuned using a novel approach called C-RLFT, inspired by offline reinforcement learning. These models are trained on a diverse dataset without needing explicit preference labels, enabling them to achieve comparable performance to models like ChatGPT, even with smaller sizes such as 7 billion parameters. The family includes versions like OpenChat 3.5 and 3.6, featuring improved coding capabilities and overall performance enhancements. These models are designed for tasks like chat, conversation, text generation, and coding, and are licensed under Apache 2.0. They are highly optimized for efficiency and speed, often utilizing quantization methods, and are compatible with a wide range of clients and libraries, making them accessible to many users 27.

Specifications(7 models)

OpenChat 3 model specifications comparison
ModelReleasedContextParametersStructured Outputs
OpenChat 3.6 8B2024-058K8BYes
OpenChat 3.12024-014K13BNo
OpenChat 3.22024-014K13BNo
OpenChat 3.2 Super2024-014K13BNo
OpenChat 3.5 (0106)2024-018K7BYes
OpenChat 3.5 Gemma2024-018K7BNo
OpenChat 3.5 (1210)2023-128K7BNo

Available From(5 providers)

Pricing

OpenChat 3 model pricing by provider
ModelProviderInput / 1MOutput / 1MType
OpenChat 3.6 8BDeepInfra$0.05$0.15Serverless
OpenChat 3.5 (0106)Lepton AI API$0.07$0.07Serverless
OpenChat 3.5 (0106)Together AI$0.2$0.2Serverless
OpenChat 3.5 (0106)Fireworks AI$0.2$0.2Provisioned

Frequently Asked Questions

What is OpenChat 3?
The OpenChat 3 family consists of open-source large language models (LLMs) that are fine-tuned using a novel approach called C-RLFT, inspired by offline reinforcement learning. These models are trained on a diverse dataset without needing explicit preference labels, enabling them to achieve comparable performance to models like ChatGPT, even with smaller sizes such as 7 billion parameters. The family includes versions like OpenChat 3.5 and 3.6, featuring improved coding capabilities and overall performance enhancements. These models are designed for tasks like chat, conversation, text generation, and coding, and are licensed under Apache 2.0. They are highly optimized for efficiency and speed, often utilizing quantization methods, and are compatible with a wide range of clients and libraries, making them accessible to many users 27.
How many models are in the OpenChat 3 family?
The OpenChat 3 family contains 7 models.
What is the latest OpenChat 3 model?
The latest model is OpenChat 3.6 8B, released in 2024-05.
How much does OpenChat 3 cost?
OpenChat 3 models range from $0.05/1M to $0.2/1M input tokens depending on the model and provider.

Models(7)