LLM ReferenceLLM Reference
NVIDIA NIM

LLaVA 1.6 Mistral 7B on NVIDIA NIM

LLaVA 1.6 · Haotian Liu

Provisioned

Last refreshed 2026-05-01. Next refresh: weekly.

Why use LLaVA 1.6 Mistral 7B on NVIDIA NIM?

NVIDIA NIM offers LLaVA 1.6 Mistral 7B with competitive pricing. NVIDIA NIM is NVIDIA's deployment platform for GPU-accelerated inference microservices.

Compare LLaVA 1.6 Mistral 7B across 2 providers to find the best fit for your use case
Input / 1M
-
Output / 1M
-
Cache
Not sourced
Batch
Not sourced

Setup recipe

Docs fallback
Install
Use the provider REST API or SDK
Auth
Create a provider API key
Call
model: llava-1.6-mistral-7b
Model ID
llava-1.6-mistral-7b

Request example

Curated snippets for this provider are not sourced yet. Use NVIDIA NIM documentation with model ID llava-1.6-mistral-7b.

Gotchas

No curated gotchas have been sourced for this exact provider/model route yet.

Compare LLaVA 1.6 Mistral 7B Across Providers

ProviderInput (per 1M)Output (per 1M)
NVIDIA NIM
Replicate API$0.05$0.25

Pricing

TypeRate
GPU Hour Rate$1.00/GPU·hr
GPU Config1xH100

Capabilities

No model capability flags are currently sourced.

About LLaVA 1.6 Mistral 7B

LLaVA-v1.6 Mistral-7B is an open-source, multimodal language model capable of processing text and images. Built on the Mistral-7B-Instruct-v0.2 base, it combines a large language model with a vision encoder to enhance reasoning, optical character recognition, and world understanding. Trained on substantial datasets, including image-text pairs from LAION/CC/SBU, GPT-generated data, and VQA data, it was evaluated against 12 benchmarks. The model improves upon LLaVA-1.5 with higher image resolution processing and better reasoning, offering bilingual support and commercial licensing. It finds use in applications like chatbots, image captioning, and visual QA tasks but requires significant computational resources for high-res images.

FAQ

What is the context window for LLaVA 1.6 Mistral 7B on NVIDIA NIM?

LLaVA 1.6 Mistral 7B supports a 32,000 token context window on NVIDIA NIM.

How does NVIDIA NIM compare to other LLaVA 1.6 Mistral 7B providers?

LLaVA 1.6 Mistral 7B is available from 2 providers. The cheapest input pricing is $0.05/1M tokens from Replicate API.

Who created LLaVA 1.6 Mistral 7B?

LLaVA 1.6 Mistral 7B was created by Haotian Liu as part of the LLaVA 1.6 model family.

Is LLaVA 1.6 Mistral 7B open source?

LLaVA 1.6 Mistral 7B's open source status is unknown in the seed data.

Get Started

Model Specs

Released2024-01-31
Parameters7B
Context32K
ArchitectureDecoder Only
Knowledge cutoff2023-12

Related Models on NVIDIA NIM