LLM ReferenceLLM Reference
Replicate API

LLaVA 1.6 Mistral 7B on Replicate API

LLaVA 1.6 · Haotian Liu

Serverless

Last refreshed 2026-04-19. Next refresh: weekly.

Why use LLaVA 1.6 Mistral 7B on Replicate API?

Replicate API offers LLaVA 1.6 Mistral 7B with pay-as-you-go pricing at $0.05/1M input tokens. Replicate is a cloud-based platform that enables users to run machine learning models easily and efficiently.

Compare LLaVA 1.6 Mistral 7B across 2 providers to find the best fit for your use case
Input / 1M
$0.050
Output / 1M
$0.25
Cache
Not sourced
Batch
Not sourced

Setup recipe

Python + curl
Install
pip install replicate
Auth
export REPLICATE_API_TOKEN=...
Call
import replicate
output = replicate.run(
    "llava-1.6-mistral-7b",
    input={"prompt": "Hello"}
Model ID
llava-1.6-mistral-7b

Request example

import replicate

# reads REPLICATE_API_TOKEN from env
# llava-1.6-mistral-7b format: "owner/model-name" (latest version) or "owner/model-name:version-hash"
output = replicate.run(
    "llava-1.6-mistral-7b",
    input={"prompt": "Hello"}
)
# Output is a list or generator depending on the model
print("".join(output))

Gotchas

  • Replicate uses "owner/model-name" format (e.g. "meta/meta-llama-3-8b-instruct") for the latest version, or "owner/model-name:version-sha" to pin to a specific version. The REST endpoint splits owner and model-name into the path: /v1/models/{owner}/{model-name}/predictions.
  • The examples expect REPLICATE_API_TOKEN; rename it only if your application config maps the new variable.

Compare LLaVA 1.6 Mistral 7B Across Providers

ProviderInput (per 1M)Output (per 1M)
NVIDIA NIM
Replicate API$0.05$0.25

Pricing

TypePrice (per 1M)
Input tokens$0.05
Output tokens$0.25

Capabilities

No model capability flags are currently sourced.

About LLaVA 1.6 Mistral 7B

LLaVA-v1.6 Mistral-7B is an open-source, multimodal language model capable of processing text and images. Built on the Mistral-7B-Instruct-v0.2 base, it combines a large language model with a vision encoder to enhance reasoning, optical character recognition, and world understanding. Trained on substantial datasets, including image-text pairs from LAION/CC/SBU, GPT-generated data, and VQA data, it was evaluated against 12 benchmarks. The model improves upon LLaVA-1.5 with higher image resolution processing and better reasoning, offering bilingual support and commercial licensing. It finds use in applications like chatbots, image captioning, and visual QA tasks but requires significant computational resources for high-res images.

FAQ

What does LLaVA 1.6 Mistral 7B cost on Replicate API?

On Replicate API, LLaVA 1.6 Mistral 7B costs $0.05 per 1M input tokens and $0.25 per 1M output tokens.

What is the context window for LLaVA 1.6 Mistral 7B on Replicate API?

LLaVA 1.6 Mistral 7B supports a 32,000 token context window on Replicate API.

How does Replicate API compare to other LLaVA 1.6 Mistral 7B providers?

LLaVA 1.6 Mistral 7B is available from 2 providers. The cheapest input pricing is $0.05/1M tokens from Replicate API.

Who created LLaVA 1.6 Mistral 7B?

LLaVA 1.6 Mistral 7B was created by Haotian Liu as part of the LLaVA 1.6 model family.

Is LLaVA 1.6 Mistral 7B open source?

LLaVA 1.6 Mistral 7B's open source status is unknown in the seed data.

Get Started

Model Specs

Released2024-01-31
Parameters7B
Context32K
ArchitectureDecoder Only
Knowledge cutoff2023-12

GPU-Hour Providers(1)

Related Models on Replicate API