Using LLaVA 1.6 Hermes Yi 34B on NVIDIA NIM

Implementation guide · LLaVA 1.6 · Haotian Liu

ProvisionedOpen Source

NVIDIA NIM exposes LLaVA 1.6 Hermes Yi 34B through model ID llava-1.6-hermes-yi-34b. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.

Last refreshed 2026-05-01. Next refresh: weekly.

Quick Start

  1. 1
    Create an account at NVIDIA NIM and generate an API key.
  2. 2
    Use the NVIDIA NIM SDK or REST API to call llava-1.6-hermes-yi-34b — see the documentation for request format.
  3. 3
    You'll be billed . See full pricing.

Code Examples

See NVIDIA NIM documentation for integration details.

Pricing on NVIDIA NIM

Capabilities

No model capability flags are currently sourced.

About LLaVA 1.6 Hermes Yi 34B

LLaVA-1.6, specifically the Hermes Yi 34B variant, represents a leap in multimodal AI capabilities, enhanced from its predecessor, LLaVA 1.5. This open-source chatbot excels in processing and responding to both text and image inputs. The model boasts a fourfold increase in image resolution support, enhanced visual reasoning and OCR capabilities, and improved visual conversation and world knowledge. It leverages the Nous-Hermes-2-Yi-34B language model as its backbone, offering superior commercial licenses and bilingual support. LLaVA-1.6-34B outshines other open-source models and even competes with Google's Gemini Pro on some tasks.

Model Specs

Released2024-01-31
Parameters34B
Context200k
ArchitectureDecoder Only
Knowledge cutoff2024-03

Provider

NVIDIA NIM

NVIDIA

Santa Clara, California, United States