MetaMath Llemma 7B
MetaMath Llemma 7B is released 2023-10-27 in the MetaMath family with open-source; evaluate it while provider pricing coverage matures.
- Family
- MetaMath
- Released
- 2023-10-27
- Parameters
- 7B
- Architecture
- Decoder Only
- Specialization
- general
- Openness
- Open source
- License
- Apache 2.0OSI-approvedCommercial use: permitted
- Weights
- Unknown
- Code
- Unknown
- Training
- Fine-tuned
No tracked provider pricing is available yet.
About
MetaMath-Llemma-7B is a fine-tuned large language model designed specifically for mathematical reasoning, building upon the Llemma-7B architecture. It showcases notably enhanced performance over similar-sized open-source models in solving mathematical problems, thanks to a novel question bootstrapping method that enriches its training data with diverse mathematical questions. Trained on the comprehensive MetaMathQA dataset, which is derived from GSM8K and MATH benchmarks, the model achieves impressive scores: Pass@1 scores of 69.2% on GSM8K and 30.0% on MATH. Despite its achievements, it remains outperformed by closed-source models like GPT-4, pointing to avenues for further improvement.
Providers
No active provider routes are tracked for this model yet.
Capabilities
No model capability flags are currently sourced.
Benchmark peer barsfor Coding
No task-mapped benchmark peers are available for this model yet.
Migration checks
No linked migration route is available for this model yet.