Dolly 2.0 3B
About
Dolly 2.0 3B, developed by Databricks, is an instruction-following large language model based on the EleutherAI Pythia-2.8B architecture. It excels at natural language processing tasks such as brainstorming, classification, question answering, text generation, information extraction, and summarization. Although not state-of-the-art, it demonstrates high-quality instruction-following capabilities despite limitations in complex syntax, programming, and factual accuracy. Fine-tuned using a dataset of 15,000 instruction/response pairs created by Databricks employees, Dolly 2.0 3B is open-source and carries a CC-BY-SA license, making it suitable for applications like chatbots, text-based assistants, data analysis, and content creation. Its 3-billion parameter size allows for deployment on less powerful hardware, accommodating customization and fine-tuning for specific tasks 123.