Using LLaVA 1.6 Vicuna 7B on Replicate API
Implementation guide · LLaVA 1.6 · Haotian Liu
Replicate API exposes LLaVA 1.6 Vicuna 7B through model ID llava-1.6-vicuna-7b. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.
Last refreshed 2026-05-19. Next refresh: weekly.
Quick Start
- 1
- 2Use the Replicate API SDK or REST API to call
llava-1.6-vicuna-7b— see the documentation for request format. - 3
Code Examples
pip install replicateREPLICATE_API_TOKENllava-1.6-vicuna-7bReplicate uses "owner/model-name" format (e.g. "meta/meta-llama-3-8b-instruct") for the latest version, or "owner/model-name:version-sha" to pin to a specific version. The REST endpoint splits owner and model-name into the path: /v1/models/{owner}/{model-name}/predictions.
import replicate
# reads REPLICATE_API_TOKEN from env
# llava-1.6-vicuna-7b format: "owner/model-name" (latest version) or "owner/model-name:version-hash"
output = replicate.run(
"llava-1.6-vicuna-7b",
input={"prompt": "Hello"}
)
# Output is a list or generator depending on the model
print("".join(output))Pricing on Replicate API
| Type | Price (per 1M) |
|---|---|
| Input tokens | $0.05 |
| Output tokens | $0.25 |
Capabilities
No model capability flags are currently sourced.
About LLaVA 1.6 Vicuna 7B
LLaVA 1.6 Vicuna 7B is a sophisticated multimodal large language model that integrates a Vicuna-7B language model with a high-performing vision encoder, such as CLIP's ViT-L/14. This innovative combination enables it to process and understand both text and image inputs, making it ideal for tasks like image captioning, visual question answering, and multimodal chatbot interactions. It features enhanced image resolution capabilities, improved OCR, and logical reasoning skills, all while maintaining data efficiency. Despite these advancements, users should be aware of its performance variability and computational demands when handling high-resolution images. Being open-source, it invites community collaboration for further enhancements.