llama.cpp tools/quantize README
repo
Fields
id
sources/quant-llamacpp-quantize-readmePublisher
ggml-org
Kind
repo
Published
2026-10-03
Accessed
2026-10-03
notes
Official GGUF quantizer docs: bits/weight, size and CPU tok/s tables for Llama-3.1-8B, imatrix workflow, k-quant mixtures.
Notes
Official GGUF quantizer docs: bits/weight, size and CPU tok/s tables for Llama-3.1-8B, imatrix workflow, k-quant mixtures.
Cross-references
This record references no other records.