llama-cpp on intel-arc-pro-b70: Qwen3.5-27B gguf-q5-k-m tg128 tok/s (bentech, single B70 Vulkan)
8.5 tok/s (tg128, batch-1 per-request)
Fields
id
benchmarks/bentech-b70-qwen35-27b-q5km-tgMetric
decode_tok_s
Value
8.5
Unit
tok/s (tg128, batch-1 per-request)
Model
Qwen3.5-27B
Methodology
THIRD-PARTY MEASURED (Ben Linville/bentech, Apr 16 2026, llama-benchy 0.3.5, 25-run matrix). Arc Pro B70 32GB (BMG-G31) + B60 24GB (BMG-G21); Ryzen 7 7800X3D, 64GB DDR5, B850 PCIe4 x4 M.2 adapters; llama.cpp b1-ff5ef82 Vulkan+SYCL, Intel llm-scaler-vllm:0.14.0-b8.1 Docker (vLLM FP8 pipeline-parallel). pp512/tg128, depth0, 3 runs/test mean, no prefix caching, q8_0 KV, FA on, 8k ctx. Per-request tg, NOT aggregate. Qwen3.5-27B gguf-q5-k-m, single B70 Vulkan.
Measured by
third_party
Reproducible
yes
notes
Qwen3.5-27B gguf-q5-k-m on single B70 Vulkan: pp512 233.5 / tg128 8.5 tok/s. Single card. Q4_K_M fastest generation for the quant sweep on this hardware.
Notes
Qwen3.5-27B gguf-q5-k-m on single B70 Vulkan: pp512 233.5 / tg128 8.5 tok/s. Single card. Q4_K_M fastest generation for the quant sweep on this hardware.