inference/research
verifiedhigh · 0.90updated 2026-10-03

vLLM issue #50881: MiniMax-M3 fp8 KV cache on SM80 is coherent with --enforce-eager and garbage under CUDA graphs

forum

Fields

id
sources/qgotcha-vllm-50881-fp8kv-cudagraph-scatter
Publisher
vLLM GitHub issues
Kind
forum
Accessed
2026-10-03
notes
Reporter supplied a working fix (@eager_break_during_capture on MiniMaxM3SparseAttention._insert_kv plus routing dense KV writes through reshape_and_cache_flash). Also reports SM80 e4m3 KV is refused outright ('type fp8e4nv not supported in this architecture') so only e5m2 is loadable there.

Notes

Reporter supplied a working fix (@eager_break_during_capture on MiniMaxM3SparseAttention._insert_kv plus routing dense KV writes through reshape_and_cache_flash). Also reports SM80 e4m3 KV is refused outright ('type fp8e4nv not supported in this architecture') so only e5m2 is loadable there.

Cross-references

This record references no other records.