LLM Reference
NVIDIA NIM

LLaVA 1.6 Mistral 7B on NVIDIA NIM

LLaVA 1.6 · Haotian Liu

Provisioned

Pricing

TypePrice (per 1M)
Input tokensFree
Output tokensFree

Capabilities

VisionMultimodalReasoningFunction CallingTool UseJSON ModeCode Execution

About LLaVA 1.6 Mistral 7B

LLaVA-v1.6 Mistral-7B is an open-source, multimodal language model capable of processing text and images. Built on the Mistral-7B-Instruct-v0.2 base, it combines a large language model with a vision encoder to enhance reasoning, optical character recognition, and world understanding. Trained on substantial datasets, including image-text pairs from LAION/CC/SBU, GPT-generated data, and VQA data, it was evaluated against 12 benchmarks. The model improves upon LLaVA-1.5 with higher image resolution processing and better reasoning, offering bilingual support and commercial licensing. It finds use in applications like chatbots, image captioning, and visual QA tasks but requires significant computational resources for high-res images.

Get Started

Model Specs

Released2024-01-31
Parameters7B
Context32K
ArchitectureDecoder Only
Knowledge cutoff2023-12

Related Models on NVIDIA NIM