FLAN-UL2
2 models2022Up to 2K ctxFrom $0.185/1M input
About
The FLAN-UL2 family of large language models is an advancement of the original UL2 model, leveraging the T5 architecture. Its most notable innovation is the significant expansion of the receptive field from 512 to 2048, which greatly enhances its effectiveness for few-shot in-context learning. Unlike the UL2 model, FLAN-UL2 simplifies operations by removing the need for mode switch tokens during inference and fine-tuning. The model is fine-tuned using the "Flan" prompt tuning method and a specially curated dataset, boosting its few-shot learning abilities. Available in multiple sizes, FLAN-UL2 models can be accessed through their GitHub repository for further exploration and utilization 138.
Specifications(2 models)
| Model | Released | Context | Parameters |
|---|---|---|---|
| Flan-UL2 | 2022-10 | — | 20B |
| Flan-UL2 on IBM Watsonx | 2022-10 | 2K | — |
Available From(1 provider)
Pricing
| Model | Provider | Input / 1M | Output / 1M | Type |
|---|---|---|---|---|
| Flan-UL2 on IBM Watsonx | IBM watsonx | $0.185 | $0.185 | Serverless |
| Flan-UL2 | IBM watsonx | $5 | $5 | Serverless |
Frequently Asked Questions
- What is FLAN-UL2?
- The FLAN-UL2 family of large language models is an advancement of the original UL2 model, leveraging the T5 architecture. Its most notable innovation is the significant expansion of the receptive field from 512 to 2048, which greatly enhances its effectiveness for few-shot in-context learning. Unlike the UL2 model, FLAN-UL2 simplifies operations by removing the need for mode switch tokens during inference and fine-tuning. The model is fine-tuned using the "Flan" prompt tuning method and a specially curated dataset, boosting its few-shot learning abilities. Available in multiple sizes, FLAN-UL2 models can be accessed through their GitHub repository for further exploration and utilization 138.
- How many models are in the FLAN-UL2 family?
- The FLAN-UL2 family contains 2 models.
- What is the latest FLAN-UL2 model?
- The latest model is Flan-UL2, released in 2022-10.
- How much does FLAN-UL2 cost?
- FLAN-UL2 models range from $0.185/1M to $5/1M input tokens depending on the model and provider.
