inference/research
verifiedhigh · 0.90updated 2026-10-03

vLLM issue #53328: prepare_nvfp4_moe_layer_for_marlin warns 'Your GPU does not have native support for FP4' when the checkpoint is merely weight-only

forum

Fields

id
sources/qgotcha-vllm-53328-fp4-warning-blames-silicon
Publisher
vLLM GitHub issues
Kind
forum
Accessed
2026-10-03
notes
Demonstrated on Jetson AGX Thor (SM110) with torch.ops._C.cutlass_scaled_mm_supports_fp4(110) returning True. An identical unconditional warning also exists in compressed_tensors_moe_w4a4_mxfp4.py.

Notes

Demonstrated on Jetson AGX Thor (SM110) with torch.ops._C.cutlass_scaled_mm_supports_fp4(110) returning True. An identical unconditional warning also exists in compressed_tensors_moe_w4a4_mxfp4.py.

Cross-references

This record references no other records.