Hailo-10H (Pi AI HAT+ 2) Qwen3-1.7B compiled-model TPS
4.78 tokens/sec compiled-model TPS (Hailo-Ollama on HailoRT)
Fields
id
benchmarks/comm-hailo10h-pi-ai-hat2-qwen3-1p7b-tpsMetric
decode_tok_s
Value
4.78
Unit
tokens/sec compiled-model TPS (Hailo-Ollama on HailoRT)
Model
Qwen3-1.7B
Methodology
Vendor compiled-model TPS table (hailo_model_zoo_genai MODELS.rst); single-stream class figure, batch-1 Ollama-compatible server
Measured by
vendor
Thermal state
unknown
notes
VENDOR COMPILED-MODEL TABLE. Ceiling is ~2B params - the HAT+2 cannot run 7B+.
Notes
VENDOR COMPILED-MODEL TABLE. Ceiling is ~2B params - the HAT+2 cannot run 7B+.