GOAT Models by GOAT.AI
About
The GOAT family of LLMs, developed by the GOAT.AI research lab, is dedicated to enhancing human-AI interactions and addressing common challenges faced by large language models, such as hallucinations and context comprehension issues. Their flagship model, GOAT-7B-Community, is a refined iteration of Meta's LLaMA 2 7B model, meticulously trained on 72,000 multi-turn dialogues sourced from the GoatChat app and OpenAssistant 45. This model showcases exceptional capabilities within the open-source 7B model category, excelling in benchmarks like MMLU and BigBench Hard 5. Despite these advancements, the relatively small model size of 7 billion parameters presents challenges such as the occurrence of hallucinations 5. The GOAT.AI team is actively working to mitigate these issues through experiments with larger models and improved data cleansing methods 5. Alongside GOAT-7B-Community, the lab has introduced other specialized models like the GOAT-70B-Storytelling, intended for narrative generation tasks 3, reflecting a focus on data quality and innovative training techniques to boost performance and safety 5.
Current Variants
Use-when guidance is derived from seed capabilities, context, release, and replacement fields.
Use when the workload needs 4k context and 70B parameters.
Use when the workload needs 4k context and 7B parameters.
| Model | Use when | Released | Signals | Status |
|---|---|---|---|---|
| GOAT 70B Storytelling | Use when the workload needs 4k context and 70B parameters. | 2024-01 | 4k context70B parameters | Current |
| GOAT 7B Community | Use when the workload needs 4k context and 7B parameters. | 2024-01 | 4k context7B parameters | Current |
Release Timeline
1 release groupSpecifications(2 models)
| Model | Released | Context | Parameters |
|---|---|---|---|
| GOAT 70B Storytelling | 2024-01 | 4k | 70B |
| GOAT 7B Community | 2024-01 | 4k | 7B |
Frequently Asked Questions
- What is GOAT used for?
- The GOAT family of LLMs, developed by the GOAT.AI research lab, is dedicated to enhancing human-AI interactions and addressing common challenges faced by large language models, such as hallucinations and context comprehension issues.
- How does GOAT compare to Claude 3?
- GOAT by GOAT.AI is strongest where you need its listed use cases, while Claude 3 by Anthropic is the closest related family to check for vision and multimodal work. GOAT has 2 listed variants and reaches up to 4k context, while Claude 3 reaches up to 200k context, so compare the specs and pricing tables before choosing a production model.
- Which GOAT model should I use?
- If price is the main constraint, use the pricing table first because GOAT does not have complete provider pricing in the local data. For the most capable/latest local choice, evaluate GOAT 70B Storytelling with 4k context.