Intel perf table: YOLOv4 INT8 on Flex 170, OpenVINO, 1209 img/s (b256)
1209.0 inferences/s
Fields
id
benchmarks/intel-perf-flex170-yolov4-int8-b256Metric
tps_aggregate
Value
1,209
Unit
inferences/s
Model
YOLOv4 (COCO2017_detection)
Methodology
VENDOR-MEASURED (Intel AI performance table, measured 2023-10-24). 1x Intel Data Center GPU Flex 170 on Xeon Platinum 8360Y 2S-36C-72T host, 128GB DDR4-3200, Ubuntu 22.04. OpenVINO 2023.2, INT8 precision. Unit = images/sec (inferences/sec), NOT tokens - CV inference rows for the uncovered accel record. Batch size 256.
Measured by
vendor
notes
Vendor table, batch-256 throughput row. Vision/generation rows - first measured coverage for this part.
Notes
Vendor table, batch-256 throughput row. Vision/generation rows - first measured coverage for this part.