MT0 Large
MT0 Large is released 2024-01-01 in the MT0 family with open-source; evaluate it while provider pricing coverage matures.
Use it for
- Teams evaluating general LLM work
- Workloads that can use a 1k context window
Do not use it for
- Cost-sensitive launches that need sourced token pricing
- Vision or document-understanding workloads
- Strict JSON or tool-calling flows
- Family
- MT0
- Released
- 2024-01-01
- Context
- 1k
- Parameters
- 1.2B
- Architecture
- Decoder Only
- Specialization
- general
- Openness
- Open source
- License
- Apache 2.0OSI-approvedCommercial use: permitted
- Weights
- Unknown
- Code
- Unknown
- Training
- Fine-tuned
No tracked provider token pricing is available yet.
About
The MT0 Large language model is a versatile text-to-text transformer developed by the BigScience workshop as part of the BLOOMZ and mT0 family. It excels in following human instructions across multiple languages without explicit training for those specific tasks, thanks to its zero-shot cross-lingual generalization abilities. Although tailored for English prompts, it also efficiently handles other languages. Built on the mt5-large architecture with 1.2 billion parameters, the model was fine-tuned on the BigScience xP3 dataset, enhancing its cross-lingual capabilities for various tasks, including translation, summarization, question answering, and open-ended text generation.
Top use-case fit
No primary decision-task fit is mapped for this model yet.
Provider price ladder
No tracked provider token pricing is available for this model yet.
Capabilities
No model capability flags are currently sourced.
Benchmark peer barsfor Coding
No task-mapped benchmark peers are available for this model yet.
Migration checks
No linked migration route is available for this model yet.
No tracked provider token pricing is available yet.