Using Command R on DeepInfra

Quick Start

1. 1
   Create an account at DeepInfra and generate an API key.
2. 2
   Use the DeepInfra SDK or REST API to call command-r — see the documentation for request format.

Code Examples

import os
from openai import OpenAI

client = OpenAI(
    api_key=os.environ["DEEPINFRA_API_KEY"],
    base_url="https://api.deepinfra.com/v1/openai"
)
response = client.chat.completions.create(
    model="command-r",
    messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)

About DeepInfra

DeepInfra offers serverless AI inference with a simple API, supporting hundreds of models across text generation, embeddings, and more. Pay-per-token pricing with no upfront commitments.

DeepInfra is a cloud inference platform offering cost-effective access to open-source AI models. It provides serverless inference for leading models from Meta, Mistral, Alibaba, and others with competitive token-based pricing.

Pricing on DeepInfra

Capabilities

About Command R

Command R is a 35-billion parameter large language model developed by Cohere, tailored for enterprise-scale AI applications. It is optimized for long-context tasks such as retrieval-augmented generation (RAG) and tool use, emphasizing high performance coupled with strong accuracy. This model excels in reasoning, summarization, and question answering across ten key languages. Its use spans various enterprise applications, automating complex tasks that involve interacting with systems like CRMs, APIs, and databases. The model can process up to 128,000 tokens and integrates seamlessly with Cohere's Embed and Rerank models, enhancing accuracy and efficiency in large-scale tasks. Additionally, a more powerful iteration, Command R+ with 104 billion parameters, offers even greater capabilities.