Concepts & capability filters
GPT-Generated Unified Format
GGUF is the standard file format for running quantized open-weight models locally, used by llama.cpp and the tools built on it.
- Category
- Not classified
- Difficulty
- Not classified
- Aliases
- None tracked
- Last reviewed
- 2026-07-02
Key facts
- It packs the weights, quantization scheme, and metadata into a single file that loads across different CPU and GPU setups — the format you deal with when self-hosting a model instead of calling a hosted API.