Vicuna
8 models2023Up to 16K ctxFrom $0.1/1M input
About
The Vicuna large language model (LLM) family, developed by LMSYS, consists of open-source chat assistants fine-tuned from the LLaMA family, specifically LLaMA and Llama 2, using a diverse dataset from ShareGPT 145. Designed to deliver detailed and structured responses rivaling leading commercial models like ChatGPT and Google Bard, the Vicuna models vary in size and context window length, such as 7B, 13B parameters, and 16k tokens 1. They are primarily intended for research, with their code, weights, and demos available under a non-commercial license, ensuring accessibility for experimentation and development 4. Initial evaluations found these models reaching about 90% of ChatGPT's performance, prompting ongoing refinement 1.
Specifications(8 models)
| Model | Released | Context | Parameters | Structured Outputs |
|---|---|---|---|---|
| Vicuna 13B 16K | 2023-10 | 16K | 13B | Yes |
| Vicuna 13B | 2023-10 | 2K | 13B | Yes |
| Vicuna 7B 16K | 2023-10 | 16K | 7B | Yes |
| Vicuna 7B | 2023-10 | 2K | 7B | Yes |
| Vicuna 13B V1.5 16K | 2023-10 | 16K | 13B | No |
| Vicuna 13B V1.5 | 2023-10 | 2K | 13B | Yes |
| Vicuna 7B V1.5 16K | 2023-10 | 16K | 7B | No |
| Vicuna 7B V1.5 | 2023-10 | 2K | 7B | Yes |
Available From(3 providers)
Pricing
| Model | Provider | Input / 1M | Output / 1M | Type |
|---|---|---|---|---|
| Vicuna 13B | Replicate API | $0.1 | $0.5 | Serverless |
| Vicuna 7B V1.5 | Together AI | $0.2 | $0.2 | Serverless |
| Vicuna 13B V1.5 | Together AI | $0.3 | $0.3 | Serverless |
Frequently Asked Questions
- What is Vicuna?
- The Vicuna large language model (LLM) family, developed by LMSYS, consists of open-source chat assistants fine-tuned from the LLaMA family, specifically LLaMA and Llama 2, using a diverse dataset from ShareGPT 145. Designed to deliver detailed and structured responses rivaling leading commercial models like ChatGPT and Google Bard, the Vicuna models vary in size and context window length, such as 7B, 13B parameters, and 16k tokens 1. They are primarily intended for research, with their code, weights, and demos available under a non-commercial license, ensuring accessibility for experimentation and development 4. Initial evaluations found these models reaching about 90% of ChatGPT's performance, prompting ongoing refinement 1.
- How many models are in the Vicuna family?
- The Vicuna family contains 8 models.
- What is the latest Vicuna model?
- The latest model is Vicuna 13B 16K, released in 2023-10.
- How much does Vicuna cost?
- Vicuna models range from $0.1/1M to $0.3/1M input tokens depending on the model and provider.
