Llama 3 Swallow 70B Instruct on NVIDIA NIM
Swallow · Tokyo Institute of Technology
Last refreshed 2026-06-30. Next refresh: weekly.
Why use Llama 3 Swallow 70B Instruct on NVIDIA NIM?
NVIDIA NIM offers Llama 3 Swallow 70B Instruct with competitive pricing. NVIDIA NIM is NVIDIA's deployment platform for GPU-accelerated inference microservices.
Setup recipe
Docs fallbackUse the provider REST API or SDKCreate a provider API keymodel: tokyotech-llm/llama-3-swallow-70b-instruct-v0.1tokyotech-llm/llama-3-swallow-70b-instruct-v0.1Request example
tokyotech-llm/llama-3-swallow-70b-instruct-v0.1.Gotchas
- Use provider model ID "tokyotech-llm/llama-3-swallow-70b-instruct-v0.1", not the LLMReference slug "llama-3-swallow-70b-instruct".
Pricing
| Type | Rate |
|---|---|
| GPU Hour Rate | $1.00/GPU·hr |
| GPU Config | 4xH100 |
Capabilities
No model capability flags are currently sourced.
About Llama 3 Swallow 70B Instruct
Llama 3 Swallow 70B Instruct is Tokyo Institute of Technology's Swallow model. Its knowledge cutoff is 2023.
FAQ
What is the context window for Llama 3 Swallow 70B Instruct on NVIDIA NIM?
Llama 3 Swallow 70B Instruct supports a 4k token context window on NVIDIA NIM.
What API model ID do I use for Llama 3 Swallow 70B Instruct on NVIDIA NIM?
Use the model ID tokyotech-llm/llama-3-swallow-70b-instruct-v0.1 when calling NVIDIA NIM's API.
Who created Llama 3 Swallow 70B Instruct?
Llama 3 Swallow 70B Instruct was created by Tokyo Institute of Technology as part of the Swallow model family.
Is Llama 3 Swallow 70B Instruct open source?
Llama 3 Swallow 70B Instruct has open weights under Llama 2 Community according to the seed data, but that does not necessarily mean an OSI-approved open-source license.