llmreference

Using InternLM 7B on Bitdeer AI

Implementation guide · InternLM · Intern-AI

Serverless

Quick Start

  1. 1
    Create an account at Bitdeer AI and generate an API key.
  2. 2
    Use the Bitdeer AI SDK or REST API to call internlm-7b — see the documentation for request format.
  3. 3
    You'll be billed $0.14/1M input, $0.42/1M output tokens. See full pricing.

Code Examples

See Bitdeer AI documentation for integration details.

About Bitdeer AI

Bitdeer AI Cloud offers both serverless (pay-per-use) and dedicated (reserved GPU) deployment options for LLM inference. The platform provides OpenAI-compatible API endpoints and supports fine-tuning on dedicated instances. Models are hosted on NVIDIA H100/H200/A100 GPUs with automatic scaling.

Bitdeer Technologies Group is a Singapore-based AI infrastructure and cloud computing company. The company provides AI Cloud, a serverless and dedicated inference platform for deploying and scaling LLM and generative AI models.

Pricing on Bitdeer AI

TypePrice (per 1M)
Input tokens$0.14
Output tokens$0.42

Capabilities

No model capability flags are currently sourced.

About InternLM 7B

InternLM 7B is a state-of-the-art large language model with 7 billion parameters, developed by the Shanghai Artificial Intelligence Laboratory. It is built on the robust transformer architecture, enabling it to process long input sequences and perform complex reasoning tasks effectively. Trained on trillions of high-quality tokens from diverse sources, InternLM 7B maintains a strong knowledge base. It supports an 8k context window and offers customizable tools for user-specific applications. Rigorous evaluations demonstrate its superior performance across key competence areas, outperforming models such as LLaMA-7B and Baichuan-7B on benchmarks like MMLU and GSM8K. However, it shares typical LLM limitations, such as potential biases and domain-specific knowledge gaps, necessitating careful usage.

Model Specs

Released2023-07-06
Parameters7B
Context4K
ArchitectureDecoder Only
Knowledge cutoff2023-03

Provider

Bitdeer AI

Bitdeer Technologies Group

Singapore