Question 1

What is the context window of Gemma 2 27B?

Accepted Answer

Gemma 2 27B has a context window of 8K tokens.

Question 2

How much does Gemma 2 27B cost?

Accepted Answer

Gemma 2 27B pricing ranges from $0.08/1M to $0.3/1M input tokens depending on the provider.

Question 3

When was Gemma 2 27B released?

Accepted Answer

Gemma 2 27B was released on 2024-06-27.

Question 4

Which providers offer Gemma 2 27B?

Accepted Answer

Gemma 2 27B is available from 2 providers: GCP Vertex AI, Bitdeer AI.

Question 5

What benchmarks has Gemma 2 27B been tested on?

Accepted Answer

Gemma 2 27B has been evaluated on 5 benchmarks, including Google-Proof Q&A, HellaSwag, HumanEval, Massive Multitask Language Understanding, MMLU PRO.

Provider	Input (per 1M)	Output (per 1M)	Type
GCP Vertex AI	$0.3	$0.9	Serverless
Bitdeer AI	$0.08	$0.24	Serverless

Benchmark	Score	Version	Source
Google-Proof Q&A	56.7	diamond	research
HellaSwag	92.6	10-shot	research
HumanEval	80.4	pass@1	research
Massive Multitask Language Understanding	81.6	5-shot	research
MMLU PRO	56.5	—	https://huggingface.co/spaces/TIGER-Lab/MMLU-Pro

Gemma 2 27B

About