Using Yi 34B on Together AI

Implementation guide · Yi (2023/11) · 01.AI

Serverless

Quick Start

1
Create an account at Together AI and generate an API key.
2
Use the Together AI SDK or REST API to call yi-34b — see the documentation for request format.
3
You'll be billed $0.80/1M input, $0.80/1M output tokens. See full pricing.

API Portal Documentation Pricing

Code Examples

Install

pip install together

API key

TOGETHER_API_KEY

Model ID

yi-34b

Together uses "organization/model-name" format, e.g. "meta-llama/Llama-4-Scout-17B-16E-Instruct" or "Qwen/QwQ-32B". See the Together model catalog for the exact ID.

from together import Together

client = Together()  # reads TOGETHER_API_KEY from env
response = client.chat.completions.create(
    model="yi-34b",
    messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)