Dolly 2.0
About
Dolly 2.0 is a series of open-source large language models (LLMs) created by Databricks, based on the EleutherAI Pythia model family. These models are designed to follow instructions, enabling them to understand and complete natural language tasks effectively. Uniquely licensed for commercial use, Dolly 2.0 provides enterprises the opportunity to leverage these models without restrictive licenses. Available in three different sizes—3 billion, 7 billion, and 12 billion parameters—they offer scalability according to computational needs and performance goals. The training involves a fine-tuning process on the databricks-dolly-15k dataset, a carefully crafted instruction set by Databricks employees. While they may not represent the cutting edge of technology, Dolly 2.0 models display commendable instruction-following abilities, making them a practical choice for various applications.