Fuyu
About
Developed by Adept AI, the Fuyu large language model (LLM) family is distinct for its innovative approach in handling multimodal tasks, specifically catering to digital agents. It boasts a simplified architecture, employing a decoder-only transformer without needing a specific image encoder. Instead, image patches are directly fed as linear projections into the transformer's initial layer, which allows for flexible processing of various image resolutions. This configuration not only streamlines training but also accelerates inference, providing rapid response times under 100 milliseconds for handling large images. Although the Fuyu models are primarily optimized for digital agent applications, they demonstrate robust performance on standard image understanding benchmarks. One of the models in this family, the Fuyu-8B, is publicly available under a CC-BY-NC license, offering opportunities for research and development with the caveat that it may require fine-tuning to meet specific application needs.
Specifications(2 models)
| Model | Released | Parameters |
|---|---|---|
| Fuyu-Heavy | 2024-01 | — |
Available From(1 provider)
Frequently Asked Questions
- What is Fuyu?
- Developed by Adept AI, the Fuyu large language model (LLM) family is distinct for its innovative approach in handling multimodal tasks, specifically catering to digital agents. It boasts a simplified architecture, employing a decoder-only transformer without needing a specific image encoder. Instead, image patches are directly fed as linear projections into the transformer's initial layer, which allows for flexible processing of various image resolutions. This configuration not only streamlines training but also accelerates inference, providing rapid response times under 100 milliseconds for handling large images. Although the Fuyu models are primarily optimized for digital agent applications, they demonstrate robust performance on standard image understanding benchmarks. One of the models in this family, the Fuyu-8B, is publicly available under a CC-BY-NC license, offering opportunities for research and development with the caveat that it may require fine-tuning to meet specific application needs.
- How many models are in the Fuyu family?
- The Fuyu family contains 2 models.
- What is the latest Fuyu model?
- The latest model is Fuyu-Heavy, released in 2024-01.
