inference/research
verifiedmedium · 0.70updated 2026-10-03

vLLM documentation: GGUF quantization support

paper

Fields

id
sources/bench-meth-vllm
URL
https://docs.vllm.ai/en/latest/features/quantization/gguf.html
Publisher
vLLM project
Kind
paper
Published
2026-10-03
Accessed
2026-10-03
notes
vLLM GGUF support doc, used only as the engine-side context for the GGUF quality deltas (labels GGUF support experimental and under-optimized).

Notes

vLLM GGUF support doc, used only as the engine-side context for the GGUF quality deltas (labels GGUF support experimental and under-optimized).

Cross-references

This record references no other records.