r/LocalLLaMA: 'I spent 8+ hours benchmarking every MoE backend for Qwen3.5-397B NVFP4 on 4x RTX PRO 6000 (SM120)'
forum
Fields
id
sources/sent-src-reddit-sm120-moe-backends-1rrfqluURL
Publisher
Reddit / u/lawdawgattorney
Kind
forum
Accessed
2026-10-04
notes
Post 242 upvotes, 73 comments, shown as '7mo ago' at access 2026-10-04. Doubles as a sentiment record: the author's verdict is not about tok/s but about vendor support, and the recommended configuration is whichever backend is the surviving one. Cites CUTLASS issues 3096 and 2800, DeepGEMM 236, vLLM issues 35566 and PR 36453, FlashInfer PR 2725. Upvote count is a popularity proxy, not a measurement.
Notes
Post 242 upvotes, 73 comments, shown as '7mo ago' at access 2026-10-04. Doubles as a sentiment record: the author's verdict is not about tok/s but about vendor support, and the recommended configuration is whichever backend is the surviving one. Cites CUTLASS issues 3096 and 2800, DeepGEMM 236, vLLM issues 35566 and PR 36453, FlashInfer PR 2725. Upvote count is a popularity proxy, not a measurement.
Cross-references
This record references no other records.