InternLM2-Math
About
The InternLM2-Math family is a collection of advanced, bilingual (Chinese and English) open-source large language models specifically tuned for mathematical reasoning. These models act as solvers, provers, verifiers, and augmentors, excelling at both formal and informal mathematical reasoning tasks. They are pretrained on around 100 billion quality math-related tokens and further refined with about 2 million bilingual math-supervised data points. Notably, the models support Lean 3, a formal proof assistant that enables verifiable mathematical reasoning. Available in different variants with sizes like 7B and 20B parameters, these models offer varying levels of performance on multiple benchmarks. The InternLM2-Math-Plus series features enhancements for improved performance in both formal and informal reasoning tasks, epitomizing the latest advancements in this LLM family.
Specifications(6 models)
| Model | Released | Parameters |
|---|---|---|
| InternLM2 Math 20B | 2024-05 | 20B |
| InternLM2 Math 7B | 2024-05 | 7B |
| InternLM2 Math Plus 20B | 2024-05 | 20B |
| InternLM2 Math Plus 7B | 2024-05 | 7B |
| InternLM2 Math Plus 1.8B | 2024-05 | 1.8B |
| InternLM2 Math Plus Mixtral 8x22B | 2024-05 | 8x22B |
Frequently Asked Questions
- What is InternLM2-Math?
- The InternLM2-Math family is a collection of advanced, bilingual (Chinese and English) open-source large language models specifically tuned for mathematical reasoning. These models act as solvers, provers, verifiers, and augmentors, excelling at both formal and informal mathematical reasoning tasks. They are pretrained on around 100 billion quality math-related tokens and further refined with about 2 million bilingual math-supervised data points. Notably, the models support Lean 3, a formal proof assistant that enables verifiable mathematical reasoning. Available in different variants with sizes like 7B and 20B parameters, these models offer varying levels of performance on multiple benchmarks. The InternLM2-Math-Plus series features enhancements for improved performance in both formal and informal reasoning tasks, epitomizing the latest advancements in this LLM family.
- How many models are in the InternLM2-Math family?
- The InternLM2-Math family contains 6 models.
- What is the latest InternLM2-Math model?
- The latest model is InternLM2 Math 20B, released in 2024-05.
