Last refreshed 2026-04-19. Next refresh: weekly.
Why use Llama 3 70B Instruct on Scale AI GenAI Platform?
Scale AI GenAI Platform offers Llama 3 70B Instruct with competitive pricing. Scale AI's Generative AI Platform is designed to leverage enterprise data to customize powerful base generative models, enabling organizations to safely unlock the value of AI.
Compare Llama 3 70B Instruct across 17 providers to find the best fit for your use caseSetup recipe
Docs fallbackUse the provider REST API or SDKCreate a provider API keymodel: llama3-70b-instructllama3-70b-instructRequest example
llama3-70b-instruct.Gotchas
No curated gotchas have been sourced for this exact provider/model route yet.
Compare Llama 3 70B Instruct Across Providers
| Provider | Input (per 1M) | Output (per 1M) |
|---|---|---|
| GCP Vertex AI | $1.20 | $3.60 |
| AWS Bedrock | $0.99 | $0.99 |
| Microsoft Foundry | $3.78 | $11.34 |
| NVIDIA NIM | — | — |
| DeepInfra | $0.45 | $0.65 |
Capabilities
About Llama 3 70B Instruct
The Llama 3 70B Instruct model is a large language model with 70 billion parameters, released by Meta on April 18, 2024. It's an instruction-tuned variant optimized for conversational applications, utilizing an advanced auto-regressive transformer architecture. The model excels in following instructions and engaging in dialogue, having been trained on over 15 trillion tokens with a December 2023 knowledge cutoff. It demonstrates superior performance on industry benchmarks, scoring 82.0 on the MMLU (5-shot) test. The model incorporates extensive safety measures and optimizations, including RLHF, to enhance helpfulness and reduce harmful content generation. For more details, visit the model's Hugging Face page [1].
FAQ
What is the context window for Llama 3 70B Instruct on Scale AI GenAI Platform?
Llama 3 70B Instruct supports a 8,000 token context window on Scale AI GenAI Platform.
How does Scale AI GenAI Platform compare to other Llama 3 70B Instruct providers?
Llama 3 70B Instruct is available from 17 providers. The cheapest input pricing is $0.40/1M tokens from Hyperbolic AI Inference.
Who created Llama 3 70B Instruct?
Llama 3 70B Instruct was created by AI at Meta as part of the Llama 3 model family.
Is Llama 3 70B Instruct open source?
Llama 3 70B Instruct is open source according to the seed data.