llama.cpp issue #27178: NVFP4-to-GGUF conversion drops most NVFP4 scales; model loads (or fails) then emits one repeated token
forum
Fields
id
sources/qgotcha-llamacpp-27178-nvfp4-gguf-scales-droppedPublisher
llama.cpp GitHub issues
Kind
forum
Accessed
2026-10-03
notes
Root-caused to build_lora_mm in src/llama-graph.cpp applying the per-tensor scale only when the caller passes it, plus _generate_nvfp4_tensors in conversion/base.py removing quantized tensors before modify_tensors can synthesize QK-norm.
Notes
Root-caused to build_lora_mm in src/llama-graph.cpp applying the per-tensor scale only when the caller passes it, plus _generate_nvfp4_tensors in conversion/base.py removing quantized tensors before modify_tensors can synthesize QK-norm.
Cross-references
This record references no other records.