Using OctoML Gemma-2B-it on OctoML (Deprecated)

Quick Start

1. 1
   Create an account at OctoML (Deprecated) and generate an API key.
2. 2
   Use the OctoML (Deprecated) SDK or REST API to call octoml-gemma-2b-it — see the documentation for request format.
3. 3
   You'll be billed $0.10/1M input, $0.15/1M output tokens. See full pricing.

Code Examples

About OctoML (Deprecated)

Optimized inference platform for foundation models

OctoML is an optimized inference platform for foundation models, offering serverless and dedicated deployment with performance tuning for production AI workloads.

Pricing on OctoML (Deprecated)

Capabilities

No model capability flags are currently sourced.

About OctoML Gemma-2B-it

OctoML Gemma-2B-it is Google DeepMind's Gemma model. It offers an 8K-token context window with weights openly available for self-hosting.