Striped Hyena Models by Together.ai
About
The Striped Hyena family of large language models (LLMs), developed by Together AI and collaborators, offers an innovative approach to model architecture with its hybrid design. This family integrates multi-head, grouped-query attention and gated convolutions within Hyena blocks, which distinguishes it from conventional transformer models. This unique structure enhances training and inference capabilities, particularly for handling long sequences. The family encompasses both base models like the StripedHyena-Hessian-7B (SH 7B) and chat models such as StripedHyena-Nous-7B (SH-N 7B), all optimized for efficiency with faster processing speeds and reduced memory usage during autoregressive tasks. Designed to handle prompt lengths up to 128,000 tokens, Striped Hyena models deliver performance competitive with top open-source transformers on a variety of benchmarks 46.
Current Variants
Use-when guidance is derived from seed capabilities, context, release, and replacement fields.
Use when the workload needs 32k context, 7B parameters, and structured outputs.
Use when the workload needs 32k context, 7B parameters, and structured outputs.
| Model | Use when | Released | Signals | Status |
|---|---|---|---|---|
| StripedHyena Hessian 7B | Use when the workload needs 32k context, 7B parameters, and structured outputs. | 2023-12 | 32k context7B parametersstructured outputs | Current |
| StripedHyena Nous 7B | Use when the workload needs 32k context, 7B parameters, and structured outputs. | 2023-12 | 32k context7B parametersstructured outputs | Current |
Release Timeline
1 release groupSpecifications(2 models)
| Model | Released | Context | Parameters | Structured Outputs |
|---|---|---|---|---|
| StripedHyena Hessian 7B | 2023-12 | 32k | 7B | Yes |
| StripedHyena Nous 7B | 2023-12 | 32k | 7B | Yes |
Available From(1 provider)
Pricing
| Model | Provider | Input / 1M | Output / 1M | Type |
|---|---|---|---|---|
| StripedHyena Nous 7B | Together AI | $0.2 | $0.2 | Serverless |
| StripedHyena Hessian 7B | Together AI | $0.2 | $0.2 | Serverless |
Frequently Asked Questions
- What is Striped Hyena used for?
- Striped Hyena is used for structured outputs and coding. The family description and listed model capabilities point to those workloads as the best fit.
- How does Striped Hyena compare to Together General?
- Striped Hyena by Together.ai is strongest where you need structured outputs, while Together General by Together.ai is the closest related family to check for adjacent model selection. Striped Hyena has 2 listed variants and reaches up to 32k context, while Together General reaches up to 4k context, so compare the specs and pricing tables before choosing a production model.
- Which Striped Hyena model should I use?
- For the lowest listed input price, start with StripedHyena Nous 7B through Together AI at $0.2/1M input tokens. For the most capable/latest local choice, evaluate StripedHyena Hessian 7B with 32k context and structured outputs.
