Pythia 6.9B

About

The Pythia 6.9B model, created by EleutherAI, is a transformer-based large language model with 6.9 billion parameters. It is part of the Pythia suite of 16 models trained on the Pile in a consistent order. Aimed at research, this model explores the interpretability and behavior of LLMs, excelling in text generation and natural language tasks. However, it's not tailored for human-facing applications like chatbots, as it might yield factually inaccurate or socially sensitive outputs. Limited to English, it can reflect biases from its training data, which includes offensive materials 234.

Capabilities