MLPerf v5.1 MiTAC 8x MI325X: mixtral-8x7b Offline aggregate tok/s
67964.4 tok/s AGGREGATE over 8x MI325X
Fields
id
benchmarks/mlperf-v5-1-mitac-8xmi325x-mixtral-8x7b-offline-tokensMetric
tps_aggregate
Value
67,964.4
Unit
tok/s AGGREGATE over 8x MI325X
Model
mixtral-8x7b
Methodology
MLPerf Inference closed-division submission. v5.1, MiTAC 8x MI325X. mixtral-8x7b Offline: 67964.4 tok/s. Values quoted verbatim from the submission's mlperf_log_summary.txt (performance/run_1). AGGREGATE throughput across all accelerators in the system, NOT per-request.
Measured by
vendor
Reproducible
yes