MT0 Small
MT0 Small is released 2024-01-01 in the MT0 family with open-source; evaluate it while provider pricing coverage matures.
Use it for
- Teams evaluating general LLM work
- Workloads that can use a 1k context window
Do not use it for
- Cost-sensitive launches that need sourced token pricing
- Vision or document-understanding workloads
- Strict JSON or tool-calling flows
- Family
- MT0
- Released
- 2024-01-01
- Context
- 1k
- Parameters
- 300M
- Architecture
- Decoder Only
- Specialization
- general
- Openness
- Open source
- License
- Apache 2.0OSI-approvedCommercial use: permitted
- Weights
- Unknown
- Code
- Unknown
- Training
- Fine-tuned
No tracked provider token pricing is available yet.
About
The MT0 Small model, part of the BLOOMZ & mT0 family by the BigScience workshop, is a multilingual AI language model with 300 million parameters. Designed for zero-shot cross-lingual generalization, it can understand and follow human instructions in multiple languages without prior training. The model is fine-tuned using the cross-lingual task mixture dataset (xP3) and employs multitask finetuning for efficient multilingual performance. While optimized for English prompts, MT0 Small exhibits robust cross-lingual text generation capabilities, making it suitable for diverse language tasks. Its compact size ensures efficiency in resource-limited settings.
MT0 Small is an open-source model in the MT0 family. The structured metadata tracks a 1k-token context window. No headline benchmark score is tracked for MT0 Small yet.
Top use-case fit
No primary decision-task fit is mapped for this model yet.
Provider price ladder
No tracked provider token pricing is available for this model yet.
Capabilities
No model capability flags are currently sourced.
Benchmark peer barsfor Coding
No task-mapped benchmark peers are available for this model yet.
Migration checks
No linked migration route is available for this model yet.
Frequently asked questions
What is the context window of MT0 Small?
MT0 Small has a context window of 1k tokens.
When was MT0 Small released?
MT0 Small was released on 2024-01-01.
No tracked provider token pricing is available yet.