LLM ReferenceLLM Reference

Stable Code Alpha 3B 4K

About

Stable Code Alpha 3B 4K, developed by Stability AI, is a sophisticated large language model crafted for code completion. It boasts 3 billion parameters and is built on a transformer-based decoder-only architecture, enabling it to generate coherent code snippets effectively. With a long context window capacity of 4,096 tokens, it excels in producing multi-line code completions, suitable for complex development tasks. Pre-trained on a diverse range of popular programming languages, it employs techniques like Rotary Position Embeddings and LayerNorm Bias Terms to enhance performance. Its strong benchmark results across programming languages make it an invaluable asset for developers.

Capabilities

VisionMultimodalReasoningFunction CallingTool UseStructured OutputsCode Execution

Rankings

Specifications

Released2023-08-14
Parameters3B
Context4K
ArchitectureDecoder Only
Specializationgeneral
Trainingfinetuning

Created by

Open-source generative AI models.

London, United Kingdom
Founded 2020
Website