Using LLaVA 1.6 Mistral 7B on NVIDIA NIM

Implementation guide · LLaVA 1.6 · Haotian Liu

ProvisionedOpen Source

NVIDIA NIM exposes LLaVA 1.6 Mistral 7B through model ID llava-1.6-mistral-7b. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.

Last refreshed 2026-05-01. Next refresh: weekly.

Quick Start

  1. 1
    Create an account at NVIDIA NIM and generate an API key.
  2. 2
    Use the NVIDIA NIM SDK or REST API to call llava-1.6-mistral-7b — see the documentation for request format.
  3. 3
    You'll be billed . See full pricing.

Code Examples

See NVIDIA NIM documentation for integration details.

Pricing on NVIDIA NIM

Capabilities

No model capability flags are currently sourced.

About LLaVA 1.6 Mistral 7B

LLaVA-v1.6 Mistral-7B is an open-source, multimodal language model capable of processing text and images. Built on the Mistral-7B-Instruct-v0.2 base, it combines a large language model with a vision encoder to enhance reasoning, optical character recognition, and world understanding. Trained on substantial datasets, including image-text pairs from LAION/CC/SBU, GPT-generated data, and VQA data, it was evaluated against 12 benchmarks. The model improves upon LLaVA-1.5 with higher image resolution processing and better reasoning, offering bilingual support and commercial licensing. It finds use in applications like chatbots, image captioning, and visual QA tasks but requires significant computational resources for high-res images.

Model Specs

Released2024-01-31
Parameters7B
Context32k
ArchitectureDecoder Only
Knowledge cutoff2023-12

Provider

NVIDIA NIM

NVIDIA

Santa Clara, California, United States