OLMo 7B Twin-2T
- Family
- OLMo
- Released
- 2024-02-01
- Parameters
- 7B
- Architecture
- Decoder Only
- Knowledge cutoff
- 2023-03
- Specialization
- general
- Openness
- Open source
- License
- Apache 2.0OSI-approvedPermitted
- Weights
- Unknown
- Code
- Unknown
- Training
- Fine-tuned
No tracked provider pricing is available yet.
About
The OLMo 7B Twin-2T is a robust open-source large language model that implements a decoder-only transformer architecture with enhancements for greater stability and performance. It features non-parametric layer normalization and SwiGLU activation functions, along with Rotary positional embeddings for better sequence handling. The model, comprising 32 layers and 32 attention heads, was trained on approximately 2 trillion tokens and supports a context length of 2048. It is notable for its transparency in AI research, as all training data, code, and evaluations are publicly accessible, promoting collaborative advancements.
Providers
No active provider routes are tracked for this model yet.
Deprecated provider routes(1)
| Provider | Status | Catalog ID |
|---|---|---|
| Together AI | Deprecated | — |
Available via routers & gateways(1)
Capabilities
Benchmark peer barsfor Classification
No task-mapped benchmark peers are available for this model yet.
Migration checks
No linked migration route is available for this model yet.
No tracked provider pricing is available yet.