vLLM issue #53328: prepare_nvfp4_moe_layer_for_marlin warns 'Your GPU does not have native support for FP4' when the checkpoint is merely weight-only
forum
Fields
id
sources/qgotcha-vllm-53328-fp4-warning-blames-siliconPublisher
vLLM GitHub issues
Kind
forum
Accessed
2026-10-03
notes
Demonstrated on Jetson AGX Thor (SM110) with torch.ops._C.cutlass_scaled_mm_supports_fp4(110) returning True. An identical unconditional warning also exists in compressed_tensors_moe_w4a4_mxfp4.py.
Notes
Demonstrated on Jetson AGX Thor (SM110) with torch.ops._C.cutlass_scaled_mm_supports_fp4(110) returning True. An identical unconditional warning also exists in compressed_tensors_moe_w4a4_mxfp4.py.
Cross-references
This record references no other records.