GLM-130B
GLM-130B is released 2024-01-19 in the GLM family with open-source; evaluate it while provider pricing coverage matures.
- Family
- GLM
- Released
- 2024-01-19
- Context
- 2K
- Parameters
- 130B
- Architecture
- Decoder Only
- Specialization
- general
- Openness
- Open source
- License
- Apache 2.0OSI-approvedCommercial use: permitted
- Weights
- Unknown
- Code
- Unknown
- Training
- Fine-tuned
No tracked provider pricing is available yet.
About
GLM-130B is a cutting-edge bilingual language model developed by Tsinghua University's KEG group, comprising 130 billion parameters. It employs a bidirectional architecture based on the General Language Model (GLM) framework, with autoregressive blank infilling as the main training objective. Pre-trained on over 400 billion tokens, GLM-130B performs exceptionally well across benchmarks, even outperforming GPT-3 in tasks like language understanding and generation. It excels in zero-shot settings, supports fast inference (up to 2.5 times faster with optimization), and utilizes INT4 quantization for efficient operation on hardware such as 4 RTX 3090 GPUs.
Providers
No active provider routes are tracked for this model yet.
Capabilities
No model capability flags are currently sourced.
Benchmark peer barsfor Coding
No task-mapped benchmark peers are available for this model yet.
Migration checks
No linked migration route is available for this model yet.
No tracked provider pricing is available yet.