inference/research
verifiedhigh · 0.90updated 2026-10-03

vLLM GGUF documentation

repo

Fields

id
sources/quant-vllm-gguf-doc
URL
https://github.com/vllm-project/vllm/blob/main/docs/features/quantization/gguf.md
Publisher
vllm-project
Kind
repo
Published
2026-10-03
Accessed
2026-10-03
notes
States that vLLM treats GGUF as memory-footprint reduction and calls the support experimental and under-optimized.

Notes

States that vLLM treats GGUF as memory-footprint reduction and calls the support experimental and under-optimized.

Cross-references

This record references no other records.