LLM Reference

OpenChat 3.5 (0106) on Together AI

OpenChat 3 · Alignment Lab AI

Serverless

Pricing

TypePrice (per 1M)
Input tokens$0.20
Output tokens$0.20

Capabilities

VisionMultimodalReasoningFunction CallingTool UseJSON ModeCode Execution

About OpenChat 3.5 (0106)

OpenChat 3.5 is an open-source large language model renowned for delivering performance on par with ChatGPT despite having just 7 billion parameters compared to ChatGPT's 70 billion. Built on a transformer architecture, this model uses C-RLFT (Constrained Reinforcement Learning from Trajectories) to learn from mixed-quality data without requiring explicit preference labels. It adeptly handles tasks such as text and code generation, including languages like HTML5 and JavaScript, and excels in multi-turn conversations. OpenChat 3.5 is open-source, making it an appealing choice for developers and researchers, and it is optimized to run efficiently on consumer-grade GPUs with 24GB of RAM. The model also includes specialized modes like "Mathematical Reasoning Mode" for task-specific enhancements. However, it is not without its challenges, as it shares common LLM limitations, such as hallucination and potential safety concerns related to biased or harmful outputs.

Get Started

Model Specs

Released2024-01-06
Parameters7B
Context8K
ArchitectureDecoder Only