airoboros
About
The Airoboros family of large language models, developed by Jon Durbin, is designed to enhance instruction-following capabilities across diverse tasks such as question answering, summarization, and code generation. These models are fine-tuned using a self-instructing method and built upon various base models, including Llama 2 and MPT-30B, with sizes ranging from 7B to 70B parameters. Quantized versions optimized for different hardware setups are available on Hugging Face. The Airoboros project also includes tools for creating customized datasets, enabling the development of specialized expert models. The licensing is intricate, involving a custom license alongside the Meta Llama 2 license.