Aya 23 8B
About
Aya-23-8B is a multilingual large language model developed by Cohere For AI, featuring 8 billion parameters. As an instruction-fine-tuned model, it is adept at following instructions and is optimized for text generation and understanding. The model employs a decoder-only Transformer architecture, utilizing enhancements like parallel attention and feed-forward layers for efficiency. It supports 23 languages, including Arabic, Chinese, English, and French, and is proficient in tasks such as machine translation, chatbot interactions, and text summarization. Despite its capabilities, its performance might vary across languages, particularly those with less linguistic resources, and it has a context length limit of 8192 tokens. Training involved diverse data sources like human annotations and synthetic datasets to bolster its multilingual proficiency.
Capabilities
Benchmark Scores(4)
| Benchmark | Score | Version | Source |
|---|---|---|---|
| Google-Proof Q&A | 45.2 | diamond | Open LLM Leaderboard |
| HellaSwag | 87.3 | 10-shot | Open LLM Leaderboard |
| HumanEval | 68.5 | pass@1 | Open LLM Leaderboard |
| Massive Multitask Language Understanding | 72.8 | 5-shot | Open LLM Leaderboard |
