shenh10/DeepSeek_Simulator — measured-kernel DeepSeek V3/R1 decode throughput on H800/H20
repo
Fields
id
sources/deepseek-simulator-h800-h20-resultsPublisher
Han Shen (GitHub)
Kind
repo
Accessed
2026-10-15
notes
Test-based simulator: REAL DeepGEMM + FlashMLA kernels run on the target GPU (H800 80G, H20 96G explicitly 'tested'), then decode-phase throughput is computed for data-parallel/expert-parallel configs that cannot fit on one node. Values are tokens/sec PER DEVICE aggregate decode at large batch (b_mla 32-256, d=EP degree 24-288). It is a measured-kernel model, not an end-to-end serving trace - treat as a simulated ceiling, status=draft.
Notes
Test-based simulator: REAL DeepGEMM + FlashMLA kernels run on the target GPU (H800 80G, H20 96G explicitly 'tested'), then decode-phase throughput is computed for data-parallel/expert-parallel configs that cannot fit on one node. Values are tokens/sec PER DEVICE aggregate decode at large batch (b_mla 32-256, d=EP degree 24-288). It is a measured-kernel model, not an end-to-end serving trace - treat as a simulated ceiling, status=draft.
Cross-references
This record references no other records.