LLM ReferenceLLM Reference
NVIDIA NIM

LLaVA 1.6 Hermes Yi 34B on NVIDIA NIM

LLaVA 1.6 · Haotian Liu

Provisioned

Last refreshed 2026-05-01. Next refresh: weekly.

Why use LLaVA 1.6 Hermes Yi 34B on NVIDIA NIM?

NVIDIA NIM offers LLaVA 1.6 Hermes Yi 34B with competitive pricing. NVIDIA NIM is NVIDIA's deployment platform for GPU-accelerated inference microservices.

Compare LLaVA 1.6 Hermes Yi 34B across 2 providers to find the best fit for your use case
Input / 1M
-
Output / 1M
-
Cache
Not sourced
Batch
Not sourced

Setup recipe

Docs fallback
Install
Use the provider REST API or SDK
Auth
Create a provider API key
Call
model: llava-1.6-hermes-yi-34b
Model ID
llava-1.6-hermes-yi-34b

Request example

Curated snippets for this provider are not sourced yet. Use NVIDIA NIM documentation with model ID llava-1.6-hermes-yi-34b.

Gotchas

No curated gotchas have been sourced for this exact provider/model route yet.

Compare LLaVA 1.6 Hermes Yi 34B Across Providers

ProviderInput (per 1M)Output (per 1M)
NVIDIA NIM
Fireworks AI$0.90$0.90

Pricing

TypeRate
GPU Hour Rate$1.00/GPU·hr
GPU Config1xH100

Capabilities

No model capability flags are currently sourced.

About LLaVA 1.6 Hermes Yi 34B

LLaVA-1.6, specifically the Hermes Yi 34B variant, represents a leap in multimodal AI capabilities, enhanced from its predecessor, LLaVA 1.5. This open-source chatbot excels in processing and responding to both text and image inputs. The model boasts a fourfold increase in image resolution support, enhanced visual reasoning and OCR capabilities, and improved visual conversation and world knowledge. It leverages the Nous-Hermes-2-Yi-34B language model as its backbone, offering superior commercial licenses and bilingual support. LLaVA-1.6-34B outshines other open-source models and even competes with Google's Gemini Pro on some tasks. Its training efficiency is impressive, requiring just one day on 32 A100 GPUs, and a demo for chat, image captioning, and visual question answering is accessible online.

FAQ

What is the context window for LLaVA 1.6 Hermes Yi 34B on NVIDIA NIM?

LLaVA 1.6 Hermes Yi 34B supports a 200,000 token context window on NVIDIA NIM.

How does NVIDIA NIM compare to other LLaVA 1.6 Hermes Yi 34B providers?

LLaVA 1.6 Hermes Yi 34B is available from 2 providers. The cheapest input pricing is $0.90/1M tokens from Fireworks AI.

Who created LLaVA 1.6 Hermes Yi 34B?

LLaVA 1.6 Hermes Yi 34B was created by Haotian Liu as part of the LLaVA 1.6 model family.

Is LLaVA 1.6 Hermes Yi 34B open source?

LLaVA 1.6 Hermes Yi 34B's open source status is unknown in the seed data.

Get Started

Model Specs

Released2024-01-31
Parameters34B
Context200K
ArchitectureDecoder Only
Knowledge cutoff2024-03

Related Models on NVIDIA NIM