MT0 Base
MT0 Base is released 2024-01-01 in the MT0 family with open-source; evaluate it while provider pricing coverage matures.
Use it for
- Teams evaluating general LLM work
- Workloads that can use a 1k context window
Do not use it for
- Cost-sensitive launches that need sourced token pricing
- Vision or document-understanding workloads
- Strict JSON or tool-calling flows
- Family
- MT0
- Released
- 2024-01-01
- Context
- 1k
- Parameters
- 580M
- Architecture
- Decoder Only
- Specialization
- general
- Openness
- Open source
- License
- Apache 2.0OSI-approvedCommercial use: permitted
- Weights
- Unknown
- Code
- Unknown
- Training
- Fine-tuned
No tracked provider token pricing is available yet.
About
The MT0 Base model is a multilingual text-to-text transformer that belongs to the BLOOMZ and mT0 family of models, excelling at zero-shot learning by following human instructions across multiple languages without needing prior explicit training. It is constructed on the architecture of the mt5-base model and fine-tuned using the BigScience xP3 dataset, which is a blend of cross-lingual tasks. A key feature of this model is its ability to generalize effectively across languages and tasks, enabling it to perform well on unseen cross-lingual tasks. Although it is primarily recommended for English prompts, it showcases impressive capabilities in various other languages. The quality of its outputs can be significantly improved through effective prompt engineering, where structured and clear prompts lead to better performance.
MT0 Base is an open-source model in the MT0 family. The structured metadata tracks a 1k-token context window. No headline benchmark score is tracked for MT0 Base yet.
Top use-case fit
No primary decision-task fit is mapped for this model yet.
Provider price ladder
No tracked provider token pricing is available for this model yet.
Capabilities
No model capability flags are currently sourced.
Benchmark peer barsfor Coding
No task-mapped benchmark peers are available for this model yet.
Migration checks
No linked migration route is available for this model yet.
Frequently asked questions
What is the context window of MT0 Base?
MT0 Base has a context window of 1k tokens.
When was MT0 Base released?
MT0 Base was released on 2024-01-01.
No tracked provider token pricing is available yet.