FLAN-T5
About
The FLAN-T5 family of large language models is a set of enhanced versions of the original T5 (Text-to-Text Transfer Transformer) models, introduced in the paper "Scaling Instruction-Finetuned Language Models" 489. These models incorporate improvements from T5 version 1.1 and have undergone instruction finetuning on a diverse mixture of over 1,000 tasks across multiple languages 2)3. The extensive fine-tuning enhances their zero-shot and few-shot performance, making them versatile for various natural language processing tasks 489. Google offers several FLAN-T5 variants, such as small, base, large, XL, and XXL, each varying in size and computational needs 489. They are accessible through the Hugging Face Transformers library, facilitating their application in numerous contexts 489. However, they were trained on data without filtering for explicit content or bias assessment, which may result in the generation of inappropriate content or the perpetuation of existing biases 1.
Specifications(5 models)
| Model | Released | Context | Parameters |
|---|---|---|---|
| Flan-T5 XXL | 2022-10 | — | 11B |
| Flan-T5 XL | 2022-10 | — | 3B |
| Flan-T5 Large | 2022-10 | 512 | 780M |
| Flan-T5 Small | 2022-10 | 512 | 80M |
| Flan-T5 Base | 2022-10 | 512 | 250M |
Available From(2 providers)
Pricing
| Model | Provider | Input / 1M | Output / 1M | Type |
|---|---|---|---|---|
| Flan-T5 XL | IBM watsonx | $0.6 | $0.6 | Serverless |
| Flan-T5 XXL | IBM watsonx | $1.8 | $1.8 | Serverless |
Frequently Asked Questions
- What is FLAN-T5?
- The FLAN-T5 family of large language models is a set of enhanced versions of the original T5 (Text-to-Text Transfer Transformer) models, introduced in the paper "Scaling Instruction-Finetuned Language Models" 489. These models incorporate improvements from T5 version 1.1 and have undergone instruction finetuning on a diverse mixture of over 1,000 tasks across multiple languages 2)3. The extensive fine-tuning enhances their zero-shot and few-shot performance, making them versatile for various natural language processing tasks 489. Google offers several FLAN-T5 variants, such as small, base, large, XL, and XXL, each varying in size and computational needs 489. They are accessible through the Hugging Face Transformers library, facilitating their application in numerous contexts 489. However, they were trained on data without filtering for explicit content or bias assessment, which may result in the generation of inappropriate content or the perpetuation of existing biases 1.
- How many models are in the FLAN-T5 family?
- The FLAN-T5 family contains 5 models.
- What is the latest FLAN-T5 model?
- The latest model is Flan-T5 XXL, released in 2022-10.
- How much does FLAN-T5 cost?
- FLAN-T5 models range from $0.6/1M to $1.8/1M input tokens depending on the model and provider.
