LLM Reference

OpenChat 3.5 Gemma

About

The OpenChat 3.5-0106-Gemma is a 7-billion parameter large language model celebrated for its impressive performance, particularly as the top Gemma variant. Developed by OpenChat, it uses the C-RLFT approach, training on the openchat-3.5-0106 dataset to handle mixed-quality data effectively without preference labels. It excels in diverse tasks like machine translation, code generation, and conversational AI, outperforming other versions and operating efficiently on consumer hardware with sufficient VRAM. However, users should be aware of potential hallucinations and biases, and ensure critical information from the model is verified.

Capabilities

MultimodalFunction CallingTool UseJSON Mode

Specifications

Parameters7B
Context8K
ArchitectureDecoder Only
Specializationgeneral