About
Salesforce AI Research has developed the XGen family of large language models (LLMs), which encompasses both unimodal and multimodal models. The XGen-MM (BLIP-3) models are multimodal, capable of processing both image and text data 46. These models excel at various visual language tasks, thanks to their training on extensive and high-quality datasets 46. On the unimodal side, the XGen models, including XGen-7B, focus on long sequence modeling with training capacities of up to 8K sequence lengths, enabling them to handle extensive textual contexts 9. These unimodal models demonstrate impressive performance across various NLP benchmarks 9. Furthermore, Salesforce has contributed to the open-source community by making many of these models available on Hugging Face 345.