inference/research
verifiedhigh · 0.85updated 2026-10-03

SGLang issue 40877: [SM120] DeepSeek-V4.1-Flash field report on 8x RTX PRO 6000 (PCIe, no NVLink)

repo

Fields

id
sources/mgpu-sglang-40877-sm120-pcie-field-report
URL
https://github.com/sgl-project/sglang/issues/40877
Publisher
sgl-project/sglang
Kind
repo
Published
2026-09-23
Accessed
2026-10-03
notes
Measured PCIe-only scaling ceiling: 6,853 tok/s at 128K cold prefill, GPU util ~87% at 220 W of a 600 W cap, described as communication-bound rather than compute-bound.

Notes

Measured PCIe-only scaling ceiling: 6,853 tok/s at 128K cold prefill, GPU util ~87% at 220 W of a 600 W cap, described as communication-bound rather than compute-bound.

Cross-references

This record references no other records.