NVIDIA H100 NVL 94GB x2 (Cisco X215M8), MLPerf Offline (v5.0): Llama-2-70B aggregate tok/s
3879.95 output tok/s AGGREGATE across 2x H100-NVL-94GB (Offline (v5.0); ~1940 tok/s per card)
Fields
id
benchmarks/h100nvl-2x-mlperf-v5-0-llama2-70b-offline-tokens-x215Metric
tps_aggregate
Value
3,879.95
Unit
output tok/s AGGREGATE across 2x H100-NVL-94GB (Offline (v5.0); ~1940 tok/s per card)
Model
Llama-2-70B (FP8)
Methodology
VENDOR-MEASURED (MLPerf closed submission, Cisco X215M8). 2x H100-NVL-94GB (PCIe, 3-card NVLink bridge pair), TensorRT, Llama-2-70B FP8, Offline (v5.0). 'Tokens per second' = 3879.95 verbatim from mlperf_log_summary.txt. AGGREGATE across 2 cards — NOT a single-user decode figure (~1940/card).
Measured by
vendor
Reproducible
yes