Question 1

What is the context window of Llama 3.2 3B Instruct?

Accepted Answer

Llama 3.2 3B Instruct has a context window of 128K tokens.

Question 2

How much does Llama 3.2 3B Instruct cost?

Accepted Answer

Llama 3.2 3B Instruct pricing ranges from $0.05/1M to $0.1/1M input tokens depending on the provider.

Question 3

When was Llama 3.2 3B Instruct released?

Accepted Answer

Llama 3.2 3B Instruct was released on 2024-09-25.

Question 4

Which providers offer Llama 3.2 3B Instruct?

Accepted Answer

Llama 3.2 3B Instruct is available from 4 providers: OpenRouter, Fireworks AI, NVIDIA NIM, AWS Bedrock.

Question 5

What benchmarks has Llama 3.2 3B Instruct been tested on?

Accepted Answer

Llama 3.2 3B Instruct has been evaluated on 2 benchmarks, including BFCL, MMLU PRO.

Provider	Input (per 1M)	Output (per 1M)	Type
OpenRouter	$0.051	$0.34	Serverless
Fireworks AI	$0.1	$0.1	Serverless
NVIDIA NIM	—	—	Serverless
AWS Bedrock	$0.05	$0.08	Serverless

Benchmark	Score	Version	Source
BFCL	21.9	—	https://gorilla.cs.berkeley.edu/leaderboard.html
MMLU PRO	34.7	—	https://huggingface.co/spaces/TIGER-Lab/MMLU-Pro

Llama 3.2 3B Instruct

About