WizardCoder 3B

Released
2024-01-29
Last refreshed
2026-10-12
Status
Researched 150d ago
Open sourceCommercial use: permitted

WizardCoder 3B is released 2024-01-29 in the WizardCoder family with open-source; evaluate it while provider pricing coverage matures.

Specifications
Released
2024-01-29
Context
8K
Parameters
3B
Architecture
Decoder Only
Specialization
general
Openness
Open source
License
Apache 2.0OSI-approvedCommercial use: permitted
Weights
Unknown
Code
Unknown
Training
Fine-tuned
Created by

Advancing Language Model Capabilities

N/A
Founded N/A
Website
Pricing

No tracked provider pricing is available yet.

About

WizardCoder 3B is an advanced large language model specializing in code-related tasks, based on the StarCoder architecture, a decoder-only transformer akin to LLaMA. It comprises 3 billion parameters and was trained on an extensive dataset from open-source code repositories and mathematical domains. This model excels in code generation, task completion, and offers a "Fill in the Middle" (FIM) feature. Despite its strong performance on benchmarks like HumanEval and MBPP, there are potential limitations such as biases from its training data and task-specific performance variations. Additionally, a more powerful variant, WizardCoder-33B-V1.1, is available, enhancing its capabilities further 236.

Providers

No active provider routes are tracked for this model yet.

Capabilities

No model capability flags are currently sourced.

Benchmark peer barsfor Coding

No task-mapped benchmark peers are available for this model yet.

Migration checks

No linked migration route is available for this model yet.