LLM ReferenceLLM Reference
Together AI

Together AI Llama-3-8B-Instruct on Together AI

Llama 3 · AI at Meta

ServerlessOpen Source

Last refreshed 2026-05-11. Next refresh: weekly.

Why use Together AI Llama-3-8B-Instruct on Together AI?

Together AI offers Together AI Llama-3-8B-Instruct with pay-as-you-go pricing at $0.20/1M input tokens. Together AI is a platform for running open-source and proprietary LLMs with fast serverless and dedicated endpoints at competitive inference pricing.

Input / 1M
$0.20
Output / 1M
$0.20
Cache
Not sourced
Batch
Not sourced

Setup recipe

Python + curl
Install
pip install together
Auth
export TOGETHER_API_KEY=...
Call
from together import Together
client = Together()  # reads TOGETHER_API_KEY from env
response = client.chat.completions.create(
    model="together-llama-3-8b-instruct",
Model ID
together-llama-3-8b-instruct

Request example

from together import Together

client = Together()  # reads TOGETHER_API_KEY from env
response = client.chat.completions.create(
    model="together-llama-3-8b-instruct",
    messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)

Gotchas

  • Together uses "organization/model-name" format, e.g. "meta-llama/Llama-4-Scout-17B-16E-Instruct" or "Qwen/QwQ-32B". See the Together model catalog for the exact ID.
  • The examples expect TOGETHER_API_KEY; rename it only if your application config maps the new variable.

Pricing

TypePrice (per 1M)
Input tokens$0.20
Output tokens$0.20

Capabilities

Structured Outputs

About Together AI Llama-3-8B-Instruct

Llama 3 8B Instruct via Together AI

FAQ

What does Together AI Llama-3-8B-Instruct cost on Together AI?

On Together AI, Together AI Llama-3-8B-Instruct costs $0.2 per 1M input tokens and $0.2 per 1M output tokens.

What is the context window for Together AI Llama-3-8B-Instruct on Together AI?

Together AI Llama-3-8B-Instruct supports a 8,192 token context window on Together AI.

Who created Together AI Llama-3-8B-Instruct?

Together AI Llama-3-8B-Instruct was created by AI at Meta as part of the Llama 3 model family.

Is Together AI Llama-3-8B-Instruct open source?

Together AI Llama-3-8B-Instruct is open source according to the seed data.

Get Started

Model Specs

Released2024-04-18
Parameters8B
Context8K
ArchitectureDecoder Only
Knowledge cutoff2024-03