inference/research
verifiedlow · 0.45updated 2026-10-15

shenh10/DeepSeek_Simulator — measured-kernel DeepSeek V3/R1 decode throughput on H800/H20

repo

Fields

id
sources/deepseek-simulator-h800-h20-results
Publisher
Han Shen (GitHub)
Kind
repo
Accessed
2026-10-15
notes
Test-based simulator: REAL DeepGEMM + FlashMLA kernels run on the target GPU (H800 80G, H20 96G explicitly 'tested'), then decode-phase throughput is computed for data-parallel/expert-parallel configs that cannot fit on one node. Values are tokens/sec PER DEVICE aggregate decode at large batch (b_mla 32-256, d=EP degree 24-288). It is a measured-kernel model, not an end-to-end serving trace - treat as a simulated ceiling, status=draft.

Notes

Test-based simulator: REAL DeepGEMM + FlashMLA kernels run on the target GPU (H800 80G, H20 96G explicitly 'tested'), then decode-phase throughput is computed for data-parallel/expert-parallel configs that cannot fit on one node. Values are tokens/sec PER DEVICE aggregate decode at large batch (b_mla 32-256, d=EP degree 24-288). It is a measured-kernel model, not an end-to-end serving trace - treat as a simulated ceiling, status=draft.

Cross-references

This record references no other records.