LLM Reference

OpenChat 3.5 (0106)

About

OpenChat 3.5 is an open-source large language model renowned for delivering performance on par with ChatGPT despite having just 7 billion parameters compared to ChatGPT's 70 billion. Built on a transformer architecture, this model uses C-RLFT (Constrained Reinforcement Learning from Trajectories) to learn from mixed-quality data without requiring explicit preference labels. It adeptly handles tasks such as text and code generation, including languages like HTML5 and JavaScript, and excels in multi-turn conversations. OpenChat 3.5 is open-source, making it an appealing choice for developers and researchers, and it is optimized to run efficiently on consumer-grade GPUs with 24GB of RAM. The model also includes specialized modes like "Mathematical Reasoning Mode" for task-specific enhancements. However, it is not without its challenges, as it shares common LLM limitations, such as hallucination and potential safety concerns related to biased or harmful outputs.

Capabilities

MultimodalFunction CallingTool UseJSON Mode

Providers(4)

ProviderInput (per 1M)Output (per 1M)Type
Lepton AI API
Serverless
Cloudflare Workers AI
Serverless
Together AI API$0.2$0.2
Serverless
Fireworks AI Platform
Provisioned

Specifications

Released2024-01-06
Parameters7B
Context8K
ArchitectureDecoder Only
Specializationgeneral