GPT-Generated Unified Format

GGUF is the standard file format for running quantized open-weight models locally, used by llama.cpp and the tools built on it. It packs the weights, quantization scheme, and metadata into a single file that loads across different CPU and GPU setups — the format you deal with when self-hosting a model instead of calling a hosted API.