LeaseWeb: DeepSeek-R1-8B Q4_K_M on dual EPYC 9334, TTFT ~4.2s (512-tok prompt)
4200.0 ms (time-to-first-token, 512-token prompt)
Fields
id
benchmarks/leaseweb-epyc9334x2-deepseek8b-q4-ttftMetric
ttft_ms
Value
4,200
Unit
ms (time-to-first-token, 512-token prompt)
Model
DeepSeek-R1-0528-Qwen3-8B Q4_K_M
Methodology
THIRD-PARTY MEASURED (LeaseWeb blog, Fran Baigorri Hauen, 2026-04-05). HPE ProLiant DL385 Gen11, 2x EPYC 9334 (Zen4, 32c/64t each, 2.7GHz, 210W, 128MB L3/socket), 64GB DDR5 total (12-channel/socket). llama-bench (llama.cpp) local run + OpenLLM/llmperf API-level check. Test config: 512-token prompt, 128 tokens generated, 24 CPU threads for LLM rows. Values read off published charts/prose; CPU util 20-30%. TTFT band 3.6-4.8s across Q4 models per article text.
Measured by
third_party
Reproducible
no
notes
Chart value; band 3.6s (GPT-OSS-20B) to 4.8s (Llama-2-7B); DeepSeek sits mid-band.
Notes
Chart value; band 3.6s (GPT-OSS-20B) to 4.8s (Llama-2-7B); DeepSeek sits mid-band.