TinyLlama
Open-source small language model project.
About
TinyLlama is an open-source research project focused on pretraining a 1.1B parameter Llama model on 3 trillion tokens, demonstrating that small, efficient models can be competitive with larger counterparts on common benchmarks.
Model Families
Information
Founded2023
Singapore