Using Gemma 2 9B Instruct on Featherless

Quick Start

1. 1
   Create an account at Featherless and generate an API key.
2. 2
   Use the Featherless SDK or REST API to call google/gemma-2-9b-it — see the documentation for request format.
3. 3
   You'll be billed $0.43/1M input, $1.12/1M output tokens. See full pricing.

Code Examples

import os
from openai import OpenAI

client = OpenAI(
    base_url="https://api.featherless.ai/v1",
    api_key=os.environ["FEATHERLESS_API_KEY"],
)
response = client.chat.completions.create(
    model="google/gemma-2-9b-it",
    messages=[{"role": "user", "content": "Hello!"}],
)
print(response.choices[0].message.content)

Pricing on Featherless

Capabilities

About Gemma 2 9B Instruct

Gemma 2 9B Instruct, developed by Google, is a state-of-the-art large language model based on the advanced Gemini framework. It is a decoder-only transformer model with 9 billion parameters, offering a balance between size and performance. The model is trained on an expansive dataset comprising 8 trillion tokens, including web documents, code, and mathematical text, a notable 30% increase from its predecessor, Gemma 1.1. This allows it to adeptly handle diverse tasks such as question answering, creative writing, coding, and mathematical problem-solving.