LLM Reference

Grok-0

About

Grok-0, developed by xAI, is a large language model (LLM) that boasts 33 billion parameters 237. It impressively performs on par with Meta's 70-billion parameter LLaMA 2 model, despite utilizing only half the training resources, highlighting its architectural efficiency and optimization 235. Grok-0 served as the prototype for this efficient design before being succeeded by Grok-1, which further enhanced reasoning and coding capabilities 2.

Capabilities

VisionMultimodalReasoningFunction CallingTool UseJSON ModeCode Execution

Rankings

Specifications

FamilyGrok
Released2023-08-18
ArchitectureDecoder Only
Specializationgeneral
Trainingfinetuning