WizardCoder 1B

About

WizardCoder 1B is a specialized language model for code generation tasks, built on the StarCoder architecture with a transformer model utilizing multi-query attention and a fill-in-the-middle objective. It features 1 billion parameters and has been fine-tuned using the Evol-Instruct method to excel at following complex coding instructions. WizardCoder 1B can generate code snippets across various programming languages, complete code, and provide summaries. Its training set, rich in code-related instructions, enhances its performance on benchmarks like HumanEval and MBPP. Despite its proficiency, potential inconsistencies in code quality and reliance on clear instructions are noted limitations.

Capabilities