Llama 3 70B Instruct on Hyperbolic AI Inference

Llama 3 · AI at Meta

ServerlessOpen Weights

Last refreshed 2026-07-09. Next refresh: weekly.

Why use Llama 3 70B Instruct on Hyperbolic AI Inference?

Hyperbolic AI Inference offers Llama 3 70B Instruct with pay-as-you-go pricing at $0.40/1M input tokens. Hyperbolic is building an open-access AI cloud platform that provides affordable inference and compute resources for AI applications.

Compare Llama 3 70B Instruct across 18 providers to find the best fit for your use case
Input / 1M
$0.40
Output / 1M
$0.40
Cache
Not sourced
Batch
Not sourced

Setup recipe

Docs fallback
Install
Use the provider REST API or SDK
Auth
Create a provider API key
Call
model: llama3-70b-instruct
Model ID
llama3-70b-instruct

Request example

Curated snippets for this provider are not sourced yet. Use Hyperbolic AI Inference documentation with model ID llama3-70b-instruct.

Gotchas

No curated gotchas have been sourced for this exact provider/model route yet.

Compare Llama 3 70B Instruct Across Providers

ProviderInput (per 1M)Output (per 1M)
GCP Vertex AI$1.20$3.60
AWS Bedrock$0.99$0.99
Microsoft Foundry$3.78$11.34
NVIDIA NIM——
DeepInfra$0.45$0.65
View all 18 providers →

Pricing

TypePrice (per 1M)
Input tokens$0.40
Output tokens$0.40

Capabilities

Structured Outputs

About Llama 3 70B Instruct

The Llama 3 70B Instruct model is a large language model with 70 billion parameters, released by Meta on April 18, 2024. It's an instruction-tuned variant optimized for conversational applications, utilizing an advanced auto-regressive transformer architecture. The model excels in following instructions and engaging in dialogue, having been trained on over 15 trillion tokens with a December 2023 knowledge cutoff. It demonstrates superior performance on industry benchmarks, scoring 82.0 on the MMLU (5-shot) test. The model incorporates extensive safety measures and optimizations, including RLHF, to enhance helpfulness and reduce harmful content generation.

Get Started