LLM ReferenceLLM Reference
Replicate API

Vicuna 13B on Replicate API

Vicuna · LMSYS Org

Serverless

Last refreshed 2026-04-19. Next refresh: weekly.

Why use Vicuna 13B on Replicate API?

Replicate API offers Vicuna 13B with pay-as-you-go pricing at $0.10/1M input tokens. Replicate is a cloud-based platform that enables users to run machine learning models easily and efficiently.

Compare Vicuna 13B across 2 providers to find the best fit for your use case
Input / 1M
$0.10
Output / 1M
$0.50
Cache
Not sourced
Batch
Not sourced

Setup recipe

Python + curl
Install
pip install replicate
Auth
export REPLICATE_API_TOKEN=...
Call
import replicate
output = replicate.run(
    "vicuna-13b",
    input={"prompt": "Hello"}
Model ID
vicuna-13b

Request example

import replicate

# reads REPLICATE_API_TOKEN from env
# vicuna-13b format: "owner/model-name" (latest version) or "owner/model-name:version-hash"
output = replicate.run(
    "vicuna-13b",
    input={"prompt": "Hello"}
)
# Output is a list or generator depending on the model
print("".join(output))

Gotchas

  • Replicate uses "owner/model-name" format (e.g. "meta/meta-llama-3-8b-instruct") for the latest version, or "owner/model-name:version-sha" to pin to a specific version. The REST endpoint splits owner and model-name into the path: /v1/models/{owner}/{model-name}/predictions.
  • The examples expect REPLICATE_API_TOKEN; rename it only if your application config maps the new variable.

Compare Vicuna 13B Across Providers

ProviderInput (per 1M)Output (per 1M)
GCP Vertex AI
Replicate API$0.10$0.50

Pricing

TypePrice (per 1M)
Input tokens$0.10
Output tokens$0.50

Capabilities

Structured Outputs

About Vicuna 13B

Vicuna-13B is a finely-tuned open-source chatbot derived from the LLaMA model and developed with around 70,000 user-shared conversations from ShareGPT. Built on the robust Transformer architecture, it features a substantial 13-billion parameter scale. Early evaluations indicate it achieves over 90% of the effectiveness of models like OpenAI's ChatGPT and Google's Bard, surpassing other open-source models such as LLaMA and Stanford Alpaca in various scenarios. Training data includes user conversations initially captured in HTML and converted to markdown for quality filtering. Noteworthy advancements include memory optimizations allowing a context length of 2048 and enhanced multi-turn conversation handling, although it faces challenges in reasoning, mathematics, and factual consistency. It lacks complete optimization for safety and bias reduction. Available in several versions, including a 4-bit quantized edition for efficiency, Vicuna-13B is accessible for non-commercial application.

FAQ

What does Vicuna 13B cost on Replicate API?

On Replicate API, Vicuna 13B costs $0.10 per 1M input tokens and $0.50 per 1M output tokens.

What is the context window for Vicuna 13B on Replicate API?

Vicuna 13B supports a 2,000 token context window on Replicate API.

How does Replicate API compare to other Vicuna 13B providers?

Vicuna 13B is available from 2 providers. The cheapest input pricing is $0.10/1M tokens from Replicate API.

Who created Vicuna 13B?

Vicuna 13B was created by LMSYS Org as part of the Vicuna model family.

Is Vicuna 13B open source?

Vicuna 13B's open source status is unknown in the seed data.

Get Started

Model Specs

Released2023-10-23
Parameters13B
Context2K
ArchitectureDecoder Only