Using Command R on DeepInfra

Implementation guide · Command R · Cohere

ServerlessOpen Weights

DeepInfra exposes Command R through model ID command-r. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.

Last refreshed 2026-06-15. Next refresh: weekly.

Quick Start

  1. 1
    Create an account at DeepInfra and generate an API key.
  2. 2
    Use the DeepInfra SDK or REST API to call command-r — see the documentation for request format.

Code Examples

Install
pip install openai
API key
DEEPINFRA_API_KEY
Model ID
command-r

DeepInfra uses "organization/model-name" format, e.g. "meta-llama/Meta-Llama-3-8B-Instruct" or "mistralai/Mistral-7B-Instruct-v0.3". See the DeepInfra model catalog for exact IDs.

import os
from openai import OpenAI

client = OpenAI(
    api_key=os.environ["DEEPINFRA_API_KEY"],
    base_url="https://api.deepinfra.com/v1/openai"
)
response = client.chat.completions.create(
    model="command-r",
    messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)

Pricing on DeepInfra

Capabilities

Structured Outputs

About Command R

Command R is a 35-billion parameter large language model developed by Cohere, tailored for enterprise-scale AI applications. It is optimized for long-context tasks such as retrieval-augmented generation (RAG) and tool use, emphasizing high performance coupled with strong accuracy. This model excels in reasoning, summarization, and question answering across ten key languages. Its use spans various enterprise applications, automating complex tasks that involve interacting with systems like CRMs, APIs, and databases. The model can process up to 128,000 tokens and integrates seamlessly with Cohere's Embed and Rerank models, enhancing accuracy and efficiency in large-scale tasks.

Model Specs

Released2024-04-04
Parameters104B*
Context128k
ArchitectureDecoder Only

Provider

DeepInfra

San Francisco, California, United States