inference/research
verifiedhigh · 0.90updated 2026-10-03

llama.cpp issue #27178: NVFP4-to-GGUF conversion drops most NVFP4 scales; model loads (or fails) then emits one repeated token

forum

Fields

id
sources/qgotcha-llamacpp-27178-nvfp4-gguf-scales-dropped
Publisher
llama.cpp GitHub issues
Kind
forum
Accessed
2026-10-03
notes
Root-caused to build_lora_mm in src/llama-graph.cpp applying the per-tensor scale only when the caller passes it, plus _generate_nvfp4_tensors in conversion/base.py removing quantized tensors before modify_tensors can synthesize QK-norm.

Notes

Root-caused to build_lora_mm in src/llama-graph.cpp applying the per-tensor scale only when the caller passes it, plus _generate_nvfp4_tensors in conversion/base.py removing quantized tensors before modify_tensors can synthesize QK-norm.

Cross-references

This record references no other records.