Toppy Models by Undi95
About
The Toppy family of LLMs, rooted in the foundational model Toppy M 7B, is an advanced collection of models developed via innovative merging techniques. Toppy M 7B is a substantial 7-billion parameter model, crafted by integrating several other models like openchat/openchat_3.5, NousResearch/Nous-Capybara-7B-V1.9, and HuggingFaceH4/zephyr-7b-beta, utilizing the task_arithmetic merge method from mergekit 45. This process enhances the model's capabilities through the inclusion of various LoRAs (Low-Rank Adaptation) 45. Boasting multilingual abilities and proficiency in code generation, the model is versatile for multiple applications 2. The family also includes multiple quantized versions for different performance and resource balancing needs 6. It is important to note that some repositories associated with Toppy models have been flagged for sensitive content 310.
Current Variants
Use-when guidance is derived from seed capabilities, context, release, and replacement fields.
Use when the workload needs 4k context, 7B parameters, and structured outputs.
| Model | Use when | Released | Signals | Status |
|---|---|---|---|---|
| Toppy M 7B | Use when the workload needs 4k context, 7B parameters, and structured outputs. | 2023-12 | 4k context7B parametersstructured outputs | Current |
Release Timeline
1 release groupSpecifications(1 models)
| Model | Released | Context | Parameters | Structured Outputs |
|---|---|---|---|---|
| Toppy M 7B | 2023-12 | 4k | 7B | Yes |
Available From(2 providers)
Pricing
| Model | Provider | Input / 1M | Output / 1M | Type |
|---|---|---|---|---|
| Toppy M 7B | Together AI | $0.2 | $0.2 | Serverless |
| Toppy M 7B | Fireworks AI | $0.2 | $0.2 | Provisioned |
Frequently Asked Questions
- What is Toppy used for?
- Toppy is used for uncensored, structured outputs, and coding. The family description and listed model capabilities point to those workloads as the best fit.
- How does Toppy compare to Re:MythoMax?
- Toppy by Undi95 is strongest where you need uncensored, while Re:MythoMax by Undi95 is the closest related family to check for structured outputs. Toppy has 1 listed variant and reaches up to 4k context, while Re:MythoMax reaches up to 4k context, so compare the specs and pricing tables before choosing a production model.
- Which Toppy model should I use?
- For the lowest listed input price, start with Toppy M 7B through Fireworks AI at $0.2/1M input tokens. For the most capable/latest local choice, evaluate Toppy M 7B with 4k context and structured outputs.
