LLM ReferenceLLM Reference
Fireworks AI

Toppy M 7B on Fireworks AI

Toppy · Undi95

Provisioned

Last refreshed 2026-04-19. Next refresh: weekly.

Why use Toppy M 7B on Fireworks AI?

Fireworks AI offers Toppy M 7B with pay-as-you-go pricing at $0.20/1M input tokens. Fireworks AI offers a generative AI platform as a service, focusing on rapid product iteration and cost-efficient AI deployment.

Compare Toppy M 7B across 2 providers to find the best fit for your use case
Input / 1M
$0.20
Output / 1M
$0.20
Cache
Not sourced
Batch
Not sourced

Setup recipe

Python + curl
Install
pip install openai
Auth
export FIREWORKS_API_KEY=...
Call
import os
from openai import OpenAI
client = OpenAI(
    api_key=os.environ["FIREWORKS_API_KEY"],
Model ID
toppy-m-7b

Request example

import os
from openai import OpenAI

client = OpenAI(
    api_key=os.environ["FIREWORKS_API_KEY"],
    base_url="https://api.fireworks.ai/inference/v1"
)
response = client.chat.completions.create(
    model="toppy-m-7b",
    messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)

Gotchas

  • Fireworks model IDs use "accounts/fireworks/models/{model-name}" format, e.g. "accounts/fireworks/models/llama4-scout-instruct-basic" or "accounts/fireworks/models/deepseek-r1".
  • The examples expect FIREWORKS_API_KEY; rename it only if your application config maps the new variable.

Compare Toppy M 7B Across Providers

ProviderInput (per 1M)Output (per 1M)
Together AI$0.20$0.20
Fireworks AI$0.20$0.20

Pricing

TypePrice (per 1M)
Input tokens$0.20
Output tokens$0.20

Capabilities

Structured Outputs

About Toppy M 7B

Toppy M 7B is a 7-billion parameter large language model developed by Undi, designed for advanced natural language processing and sophisticated model interactions. It can handle real-time decision-making in AI-driven systems and dynamic content generation, making it highly compatible with leading AI development tools and platforms. The model supports enhanced tokenization and effective handling of special tokens. Various quantization formats, like GGUF, are available, offering trade-offs between model size, memory requirements, and performance. Users need to consider the appropriate quantization method for efficient integration into computational environments. However, the model’s limitations may include memory and processing power challenges. Notably, its Hugging Face repository is marked as "Not-For-All-Audiences" due to potentially sensitive content, suggesting possible biases or inappropriate outputs.

FAQ

What does Toppy M 7B cost on Fireworks AI?

On Fireworks AI, Toppy M 7B costs $0.20 per 1M input tokens and $0.20 per 1M output tokens.

What is the context window for Toppy M 7B on Fireworks AI?

Toppy M 7B supports a 4,000 token context window on Fireworks AI.

How does Fireworks AI compare to other Toppy M 7B providers?

Toppy M 7B is available from 2 providers. The cheapest input pricing is $0.2/1M tokens from Together AI.

Who created Toppy M 7B?

Toppy M 7B was created by Undi95 as part of the Toppy model family.

Is Toppy M 7B open source?

Toppy M 7B's open source status is unknown in the seed data.

Get Started

Model Specs

Released2023-12-20
Parameters7B
Context4K
ArchitectureDecoder Only