InternLM2 Models by Intern-AI
Last refreshed 2026-09-30. Next refresh: weekly.
Details
About
InternLM2 is an open-source large language model (LLM) family developed collaboratively by researchers from the Shanghai AI Laboratory, SenseTime Group, The Chinese University of Hong Kong, and Fudan University 157. The InternLM2 models excel in multiple benchmarks, showcasing their superior capabilities and enhanced performance over predecessors 15. These advancements are attributed to innovative pre-training and optimization techniques, emphasizing data preparation involving text, code, and extensive long-context data 1. The training regimen begins with 4k tokens, expanding to 32k tokens through successive pre-training and fine-tuning phases 1. A standout feature is the application of COOL RLHF strategy to address varied human feedback preferences and prevent reward manipulation 1. Models in the InternLM2 family vary in size, with parameters ranging from 1.8B to 20B, offering different training stage releases for community evaluation 146. Notably, they perform exceptionally well on the "Needle-in-a-Haystack" test, highlighting robust long-context processing capabilities 1. Specific variants, such as InternLM2-Math-Plus, demonstrate state-of-the-art proficiency in mathematical reasoning 4.
Decision facts
- Best fit
- codingmath-heavy prompts
- Capability starting point
- InternLM 2 Turbo with 256K context
- Lowest tracked input
- Not tracked
- Closest related family
- InternVL
Current Variants
Use-when guidance is based on each model's tracked capabilities, context window, release date, and replacement status.
Use when the workload needs 128K context and 20 parameters.
Use when the workload needs 128K context and 7 parameters.
| Model | Use when | Released | Signals | Status |
|---|---|---|---|---|
| InternLM 2 Turbo | Use when the workload needs 256K context. | 2024-06 | 256K context | Current |
| InternLM 2 20B | Use when the workload needs 128K context and 20 parameters. | 2024-01 | 128K context20 parameters | Current |
| InternLM 2 7B | Use when the workload needs 128K context and 7 parameters. | 2024-01 | 128K context7 parameters | Current |
| InternLM 2 Chat | Use when the workload needs 128K context. | 2024-01 | 128K context | Current |
| InternLM2 1.8B | Use when the workload needs 1.8B parameters. | 2024-01 | 1.8B parameters | Current |
| InternLM2 20B | Use when the workload needs 20B parameters. | 2024-01 | 20B parameters | Current |
| InternLM2 7B | Use when the workload needs 7B parameters. | 2024-01 | 7B parameters | Current |
Release Timeline
2 release groupsSpecifications(7 models)
| Model | Released | Context | Parameters |
|---|---|---|---|
| InternLM 2 Turbo | 2024-06 | 256K | — |
| InternLM 2 20B | 2024-01 | 128K | 20 |
| InternLM 2 7B | 2024-01 | 128K | 7 |
| InternLM 2 Chat | 2024-01 | 128K | — |
| InternLM2 1.8B | 2024-01 | — | 1.8B |
| InternLM2 20B | 2024-01 | — | 20B |
| InternLM2 7B | 2024-01 | — | 7B |
