verifiedhigh · 0.90updated 2026-10-03

TensorRT-LLM Quantization docs (model + hardware support matrices)

repo

Fields

id

sources/quant-trtllm-quantization

URL

https://nvidia.github.io/TensorRT-LLM/features/quantization.html

Publisher

NVIDIA

Kind

repo

Published

2026-09-26

Accessed

2026-10-03

notes

Per-GPU-arch support matrix for NVFP4/MXFP4/FP8/AWQ/GPTQ. Page dated 2026-09-26, commit c76f4a8.

Notes

Per-GPU-arch support matrix for NVFP4/MXFP4/FP8/AWQ/GPTQ. Page dated 2026-09-26, commit c76f4a8.

Cross-references

This record references no other records.