MT0 XL
MT0 XL is released 2024-01-01 in the MT0 family with open-source; evaluate it while provider pricing coverage matures.
- Family
- MT0
- Released
- 2024-01-01
- Context
- 1K
- Parameters
- 3.7B
- Architecture
- Decoder Only
- Specialization
- general
- Openness
- Open source
- License
- Apache 2.0OSI-approvedCommercial use: permitted
- Weights
- Unknown
- Code
- Unknown
- Training
- Fine-tuned
No tracked provider pricing is available yet.
About
The MT0 XL is a multilingual large language model with 3.7 billion parameters, developed by the BigScience workshop. It is part of the BLOOMZ and mT0 model families and is designed to execute diverse tasks across various languages through zero-shot capability, achieved via multitask finetuning. This process involves training pre-existing multilingual models, BLOOM and mT5, on a wide range of cross-lingual tasks (xP3). The MT0 XL operates on an architecture similar to the mT5-xl model and has been fine-tuned over 10,000 steps using 1.85 billion tokens on TPUv4-128 hardware.
Providers
No active provider routes are tracked for this model yet.
Capabilities
No model capability flags are currently sourced.
Benchmark peer barsfor Coding
No task-mapped benchmark peers are available for this model yet.
Migration checks
No linked migration route is available for this model yet.
No tracked provider pricing is available yet.