Using Command R+ on DeepInfra

Quick Start

1. 1
   Create an account at DeepInfra and generate an API key.
2. 2
   Use the DeepInfra SDK or REST API to call command-r-plus — see the documentation for request format.

Code Examples

import os
from openai import OpenAI

client = OpenAI(
    api_key=os.environ["DEEPINFRA_API_KEY"],
    base_url="https://api.deepinfra.com/v1/openai"
)
response = client.chat.completions.create(
    model="command-r-plus",
    messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)

About DeepInfra

DeepInfra offers serverless AI inference with a simple API, supporting hundreds of models across text generation, embeddings, and more. Pay-per-token pricing with no upfront commitments.

DeepInfra is a cloud inference platform offering cost-effective access to open-source AI models. It provides serverless inference for leading models from Meta, Mistral, Alibaba, and others with competitive token-based pricing.

Pricing on DeepInfra

Capabilities

About Command R+

Command R+ is a powerful large language model from Cohere, tailored for robust enterprise applications. It features an architecturally impressive 104 billion parameters and a 128k-token context window, allowing it to adeptly manage complex tasks and long dialogue sessions. Its cutting-edge capabilities include retrieval-augmented generation (RAG) with inline citations, multilingual functionality supporting ten major languages, and multi-step tool usage to automate complex workflows. The model is suited for diverse business operations such as financial analysis, customer support, and content creation, and can be accessed via Cohere's API or through platforms like Microsoft Azure and Oracle Cloud Infrastructure. Its deployment is subject to a non-commercial license, though exceptions can be considered.