DeepSeek_Simulator H800: DeepSeek-V3 decode 3121 tok/s/device (d=48 b_mla=128, two-microbatch overlap)

MEASURED-KERNEL SIMULATION (shenh10/DeepSeek_Simulator, commit 7c691017). DeepSeek V3/R1 decode phase: real DeepGEMM + FlashMLA kernels timed on H800-80G silicon, then recombined into throughput for expert-parallel configs that do not fit one node. Table values are tok/s PER DEVICE aggregate decode (attention-DP, MoE-EP; 'd' = data/expert-parallel degree, 'b_mla' = per-rank batch). Two-microbatch overlapping = DeepSeek official overlap; single-batch = compute-comm overlap. NOT an end-to-end serving number - a model-driven ceiling, filed as draft. Row: d=48, tp=1, b_mla=128; single-batch 2415 vs two-microbatch 3121 tok/s - recorded the two-microbatch peak.

SIMULATED ceiling - real measured kernels (DeepGEMM/FlashMLA on H800) but a recombination model for the cluster-level number, not a serving trace. Do NOT quote alongside end-to-end sglang/vLLM numbers; compare within the simulator's own rows.