Using Llama 3.2 1B Instruct on Bitdeer AI
Implementation guide · Llama 3.2 · AI at Meta
ServerlessOpen Source
Quick Start
- 1
- 2Use the Bitdeer AI SDK or REST API to call
llama-3.2-1b-instruct— see the documentation for request format. - 3
Code Examples
About Bitdeer AI
Bitdeer AI Cloud offers both serverless (pay-per-use) and dedicated (reserved GPU) deployment options for LLM inference. The platform provides OpenAI-compatible API endpoints and supports fine-tuning on dedicated instances. Models are hosted on NVIDIA H100/H200/A100 GPUs with automatic scaling.
Bitdeer Technologies Group is a Singapore-based AI infrastructure and cloud computing company. The company provides AI Cloud, a serverless and dedicated inference platform for deploying and scaling LLM and generative AI models.
Pricing on Bitdeer AI
| Type | Price (per 1M) |
|---|---|
| Input tokens | $0.15 |
| Output tokens | $0.45 |
Capabilities
Structured Outputs
About Llama 3.2 1B Instruct
Llama 3.2 1B Instruct is Meta's Llama 3.2 model. It offers a 128K-token context window with weights openly available for self-hosting and scores 25.6 on GPQA.
Model Specs
Released2024-09-25
Parameters1.23B
Context128K
ArchitectureDecoder Only
Knowledge cutoff2023-12