llmreference

Using Llama 3.2 1B Instruct on Bitdeer AI

Implementation guide · Llama 3.2 · AI at Meta

ServerlessOpen Source

Quick Start

  1. 1
    Create an account at Bitdeer AI and generate an API key.
  2. 2
    Use the Bitdeer AI SDK or REST API to call llama-3.2-1b-instruct — see the documentation for request format.
  3. 3
    You'll be billed $0.15/1M input, $0.45/1M output tokens. See full pricing.

Code Examples

See Bitdeer AI documentation for integration details.

About Bitdeer AI

Bitdeer AI Cloud offers both serverless (pay-per-use) and dedicated (reserved GPU) deployment options for LLM inference. The platform provides OpenAI-compatible API endpoints and supports fine-tuning on dedicated instances. Models are hosted on NVIDIA H100/H200/A100 GPUs with automatic scaling.

Bitdeer Technologies Group is a Singapore-based AI infrastructure and cloud computing company. The company provides AI Cloud, a serverless and dedicated inference platform for deploying and scaling LLM and generative AI models.

Pricing on Bitdeer AI

TypePrice (per 1M)
Input tokens$0.15
Output tokens$0.45

Capabilities

Structured Outputs

About Llama 3.2 1B Instruct

Llama 3.2 1B Instruct is Meta's Llama 3.2 model. It offers a 128K-token context window with weights openly available for self-hosting and scores 25.6 on GPQA.

Model Specs

Released2024-09-25
Parameters1.23B
Context128K
ArchitectureDecoder Only
Knowledge cutoff2023-12

Provider

Bitdeer AI

Bitdeer Technologies Group

Singapore