Last refreshed 2026-05-19. Next refresh: weekly.
Why use Breeze 7B on NVIDIA NIM?
NVIDIA NIM offers Breeze 7B with competitive pricing. NVIDIA NIM is NVIDIA's deployment platform for GPU-accelerated inference microservices.
Setup recipe
Docs fallbackUse the provider REST API or SDKCreate a provider API keymodel: breeze-7bbreeze-7bRequest example
breeze-7b.Gotchas
No curated gotchas have been sourced for this exact provider/model route yet.
Capabilities
No model capability flags are currently sourced.
About Breeze 7B
Breeze-7B is an open-source large language model from MediaTek Research, engineered upon the Mistral-7B architecture. It excels in processing Traditional Chinese while also offering strong performance in English. Its 62,000-token vocabulary enhances comprehension and generation capabilities in Traditional Chinese, resulting in roughly twice the inference speed compared to similar models like Mistral-7B and Llama 7B. Breeze-7B includes multiple variants, such as a base model and instruction-tuned versions for tasks like question answering and summarization. Although a variant with a 64k-token context length was created, it was later removed due to performance issues.