LLM ReferenceLLM Reference
Together AI

OLMo 7B on Together AI

OLMo · Allen Institute for Artificial Intelligence (AI2)

Serverless

Last refreshed 2026-05-11. Next refresh: weekly.

Why use OLMo 7B on Together AI?

Together AI offers OLMo 7B with pay-as-you-go pricing at $0.20/1M input tokens. Together AI is a platform for running open-source and proprietary LLMs with fast serverless and dedicated endpoints at competitive inference pricing.

Compare OLMo 7B across 2 providers to find the best fit for your use case
Input / 1M
$0.20
Output / 1M
$0.20
Cache
Not sourced
Batch
Not sourced

Setup recipe

Python + curl
Install
pip install together
Auth
export TOGETHER_API_KEY=...
Call
from together import Together
client = Together()  # reads TOGETHER_API_KEY from env
response = client.chat.completions.create(
    model="olmo-7b",
Model ID
olmo-7b

Request example

from together import Together

client = Together()  # reads TOGETHER_API_KEY from env
response = client.chat.completions.create(
    model="olmo-7b",
    messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)

Gotchas

  • Together uses "organization/model-name" format, e.g. "meta-llama/Llama-4-Scout-17B-16E-Instruct" or "Qwen/QwQ-32B". See the Together model catalog for the exact ID.
  • The examples expect TOGETHER_API_KEY; rename it only if your application config maps the new variable.

Compare OLMo 7B Across Providers

ProviderInput (per 1M)Output (per 1M)
Together AI$0.20$0.20
Replicate API

Pricing

TypePrice (per 1M)
Input tokens$0.20
Output tokens$0.20

Capabilities

Structured Outputs

About OLMo 7B

OLMo 7B is a large language model created by the Allen Institute for Artificial Intelligence (AI2), characterized by its open-source nature where model weights, training data, code, and evaluation tools have been publicly released. It utilizes a decoder-only transformer architecture, featuring 32 layers, a hidden size of 4096, and 32 attention heads, among other features. Trained on 2.5 trillion tokens from the Dolma dataset, this model excels in text generation, question answering, and language understanding, with performance metrics often comparable to or exceeding those of similar-sized models. It also boasts various architectural advancements such as SwiGLU activation functions and rotary positional embeddings. Despite its capabilities, users should be aware of its limitations concerning factual accuracy, bias, and context length.

FAQ

What does OLMo 7B cost on Together AI?

On Together AI, OLMo 7B costs $0.2 per 1M input tokens and $0.2 per 1M output tokens.

How does Together AI compare to other OLMo 7B providers?

OLMo 7B is available from 2 providers. The cheapest input pricing is $0.2/1M tokens from Together AI.

Who created OLMo 7B?

OLMo 7B was created by Allen Institute for Artificial Intelligence (AI2) as part of the OLMo model family.

Is OLMo 7B open source?

OLMo 7B's open source status is unknown in the seed data.

Get Started

Model Specs

Released2024-02-01
Parameters7B
ArchitectureDecoder Only

Related Models on Together AI