MLPerf v6.1 Dell XE7745 8x RTX PRO 4500: llama2-70b-99.9 Server aggregate tok/s
3012.33 tok/s AGGREGATE over 8x RTX PRO 4500
Fields
id
benchmarks/mlperf-v6-1-dell-8xrtxpro4500-llama2-70b-server-tokensMetric
tps_aggregate
Value
3,012.33
Unit
tok/s AGGREGATE over 8x RTX PRO 4500
Model
llama2-70b-99.9
Methodology
MLPerf Inference closed-division submission. v6.1, Dell XE7745 8x RTX PRO 4500. Server: 'Completed tokens per second: 3012.33'. Values quoted verbatim from the submission's mlperf_log_summary.txt (performance/run_1). AGGREGATE throughput across all accelerators in the system, NOT per-request.
Measured by
vendor
Reproducible
yes