inference/research
verifiedhigh · 0.90updated 2026-10-03

vLLM-project LLM Compressor (llmcompressor) GitHub README

repo

Fields

id
sources/qlab2-llmcompressor-readme
Publisher
vLLM project / Red Hat AI
Kind
repo
Accessed
2026-10-03
notes
Confirms llmcompressor exists and is Red Hat AI + vLLM project, Apache-2.0, 3.8k stars, 3303 commits, with the QuantizationModifier/oneshot() API, the FP8_BLOCK scheme example (block_size 128 RTN, dynamic activations), and models saved in compressed-tensors format loadable by vLLM. | SOURCE AUDIT 2026-10-03: the 'published' field held a verbatim copy of this notes paragraph instead of a date (field corruption across the qlab2-* batch); published set to null because a GitHub README, doc page or source header has no reliable publication date of its own. Content of the document itself was re-verified live 2026-10-03 and the notes are correct.

Notes

Confirms llmcompressor exists and is Red Hat AI + vLLM project, Apache-2.0, 3.8k stars, 3303 commits, with the QuantizationModifier/oneshot() API, the FP8_BLOCK scheme example (block_size 128 RTN, dynamic activations), and models saved in compressed-tensors format loadable by vLLM. | SOURCE AUDIT 2026-10-03: the 'published' field held a verbatim copy of this notes paragraph instead of a date (field corruption across the qlab2-* batch); published set to null because a GitHub README, doc page or source header has no reliable publication date of its own. Content of the document itself was re-verified live 2026-10-03 and the notes are correct.

Cross-references

This record references no other records.