LLM Reference

StarCoder+

About

StarCoder+ is a sophisticated large language model tailored for code generation and comprehension, developed as part of the BigCode project by Hugging Face and ServiceNow. Designed with an emphasis on responsible AI, StarCoder+ inherits capabilities from its predecessor, StarCoder, with enhancements potentially in efficiency and context processing. It excels in tasks like code generation, completion, and explanation, leveraging a decoder-only transformer architecture with Multi-Query Attention for improved performance. The model is trained on a vast dataset, "The Stack," encompassing diverse programming languages and is open-source, promoting collaborative advancements in AI-led coding solutions.

Capabilities

MultimodalFunction CallingTool UseJSON Mode

Specifications

FamilyStarCoder
Parameters15.5B
Context8K
ArchitectureDecoder Only
Specializationgeneral