llmreference
DeepInfra

Using Qwen2.5-Coder-32B on DeepInfra

Implementation guide · Qwen2.5-Coder · Alibaba

Serverless

Quick Start

  1. 1
    Create an account at DeepInfra and generate an API key.
  2. 2
    Use the DeepInfra SDK or REST API to call qwen2.5-coder-32b — see the documentation for request format.
  3. 3
    You'll be billed $0.20/1M input, $0.20/1M output tokens. See full pricing.

Code Examples

Install
pip install openai
API key
DEEPINFRA_API_KEY
Model ID
qwen2.5-coder-32b

DeepInfra uses "organization/model-name" format, e.g. "meta-llama/Meta-Llama-3-8B-Instruct" or "mistralai/Mistral-7B-Instruct-v0.3". See the DeepInfra model catalog for exact IDs.

import os
from openai import OpenAI

client = OpenAI(
    api_key=os.environ["DEEPINFRA_API_KEY"],
    base_url="https://api.deepinfra.com/v1/openai"
)
response = client.chat.completions.create(
    model="qwen2.5-coder-32b",
    messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)

About DeepInfra

DeepInfra offers serverless AI inference with a simple API, supporting hundreds of models across text generation, embeddings, and more. Pay-per-token pricing with no upfront commitments.

DeepInfra is a cloud inference platform offering cost-effective access to open-source AI models. It provides serverless inference for leading models from Meta, Mistral, Alibaba, and others with competitive token-based pricing.

Pricing on DeepInfra

TypePrice (per 1M)
Input tokens$0.20
Output tokens$0.20

Capabilities

Structured OutputsCode Execution

About Qwen2.5-Coder-32B

32B flagship code specialist matching GPT-4o performance with SOTA multi-language repair (75.2% on MdEval) and 3.7% improvement on repo-wide context benchmarks.

Model Specs

Released2024-11-12
Parameters32B
Context128K
ArchitectureDecoder Only
Knowledge cutoff2024-02

Provider

DeepInfra
DeepInfra

San Francisco, California, United States