LLM Reference

MT0 Base

Released
2024-01-01
Last refreshed
2026-05-19
Status
Researched 16d ago

MT0 Base has model metadata, but missing tracked provider pricing keeps it from being a default production pick.

Use it for

  • Teams evaluating general LLM work
  • Workloads that can use a 1k context window

Do not use it for

  • Cost-sensitive launches that need sourced token pricing
  • Vision or document-understanding workloads
  • Strict JSON or tool-calling flows
Specifications
Family
MT0
Released
2024-01-01
Context
1k
Parameters
580M
Architecture
Decoder Only
Specialization
general
Training
finetuned
Created by

Pioneering open-source AI collaboration

N/A
Founded 2021
Website
Pricing

No tracked provider token pricing is available yet.

About

The MT0 Base model is a multilingual text-to-text transformer that belongs to the BLOOMZ and mT0 family of models, excelling at zero-shot learning by following human instructions across multiple languages without needing prior explicit training. It is constructed on the architecture of the mt5-base model and fine-tuned using the BigScience xP3 dataset, which is a blend of cross-lingual tasks. A key feature of this model is its ability to generalize effectively across languages and tasks, enabling it to perform well on unseen cross-lingual tasks. Although it is primarily recommended for English prompts, it showcases impressive capabilities in various other languages. The quality of its outputs can be significantly improved through effective prompt engineering, where structured and clear prompts lead to better performance.

MT0 Base is a model in the MT0 family. The structured metadata tracks a 1k-token context window. No headline benchmark score is tracked for MT0 Base yet.

Top use-case fit

No primary decision-task fit is mapped for this model yet.

Provider price ladder

No tracked provider token pricing is available for this model yet.

Capabilities

No model capability flags are currently sourced.

Benchmark peer barsfor Coding

No task-mapped benchmark peers are available for this model yet.

Migration checks

No linked migration route is available for this model yet.

Rankings & picks(4)