LLM ReferenceLLM Reference

Nanbeige4-3B

nanbeige4-3b

Open SourceChina

About

Nanbeige4-3B is an open-source 3B-parameter language model by Nanbeige LLM Lab (BOSS Zhipin), released December 2025. Pre-trained on 23 trillion high-quality tokens with SFT on 30M+ diverse instructions. Context extended to 64K via Adjusted Base Frequency (ABF). Sets state-of-the-art on AIME 2024 (90.4), AIME 2025 (85.6), and GPQA-Diamond (82.2) for sub-10B models, outperforming models up to 10× larger including Qwen3-32B. arxiv: 2512.06266. HuggingFace: Nanbeige/Nanbeige4-3B-Base.

Nanbeige4-3B has a 64K-token context window.

Capabilities

VisionMultimodalReasoningFunction CallingTool UseStructured OutputsCode ExecutionPrompt CachingBatch APIAudioFine-tuning

API Versions

nanbeige4-3b-basenanbeige4-3b-thinking-2511

Rankings

Specifications

FamilyNanbeige4
Released2025-12-13
Parameters3B
Context64K
ArchitectureDecoder Only
Trainingpretrained

Created by

Massive multilingual model, open-source focus.

Beijing, China
Founded 2023
Website