MLPerf v6.1 Dell XE7745 8x RTX PRO 4500: llama2-70b-99.9 Offline 4374.06 tok/s (8B row n/a; 70B only)
4374.06 tok/s aggregate Offline
Fields
id
benchmarks/mlperf-v6-1-dell-8xrtxpro4500-llama31-8b-offline-tokensMetric
tps_aggregate
Value
4,374.06
Unit
tok/s aggregate Offline
Model
Llama-2-70B (99.9 acc)
Methodology
MLPerf Inference v6.1 published result (Dell PowerEdge XE7745, 8x RTX PRO 4500; software: TensorRT 10.14, CUDA 13.3). System-AGGREGATE output tokens/s for the named scenario, submitter-measured under MLCommons audit.
Measured by
vendor
Reproducible
yes
notes
ENGINE_ID NOTE: pinned to 'tensorrt-llm' as the closest existing engine record; the submission's actual stack is named in this methodology string.
Notes
ENGINE_ID NOTE: pinned to 'tensorrt-llm' as the closest existing engine record; the submission's actual stack is named in this methodology string.