OpenChat 3.5 (0106)
About
OpenChat 3.5 is an open-source large language model renowned for delivering performance on par with ChatGPT despite having just 7 billion parameters compared to ChatGPT's 70 billion. Built on a transformer architecture, this model uses C-RLFT (Constrained Reinforcement Learning from Trajectories) to learn from mixed-quality data without requiring explicit preference labels. It adeptly handles tasks such as text and code generation, including languages like HTML5 and JavaScript, and excels in multi-turn conversations. OpenChat 3.5 is open-source, making it an appealing choice for developers and researchers, and it is optimized to run efficiently on consumer-grade GPUs with 24GB of RAM. The model also includes specialized modes like "Mathematical Reasoning Mode" for task-specific enhancements. However, it is not without its challenges, as it shares common LLM limitations, such as hallucination and potential safety concerns related to biased or harmful outputs.
Capabilities
Providers(4)
| Provider | Input (per 1M) | Output (per 1M) | Type | |
|---|---|---|---|---|
| Lepton AI API | — | — | Serverless | |
| Cloudflare Workers AI | — | — | Serverless | |
| Together AI API | $0.2 | $0.2 | Serverless | |
| Fireworks AI Platform | — | — | Provisioned |