llama-cpp on intel-arc-pro-b70: Gemma 4 31B None pp512 tok/s (bentech, dual B70+B60 SYCL layer-split 31:23)
163.5 tok/s (pp512, batch 512)
Fields
id
benchmarks/bentech-b70-gemma4-31b-q4xl-sycl-dual-ppMetric
prefill_tok_s
Value
163.5
Unit
tok/s (pp512, batch 512)
Model
Gemma 4 31B
Methodology
THIRD-PARTY MEASURED (Ben Linville/bentech, Apr 16 2026, llama-benchy 0.3.5, 25-run matrix). Arc Pro B70 32GB (BMG-G31) + B60 24GB (BMG-G21); Ryzen 7 7800X3D, 64GB DDR5, B850 PCIe4 x4 M.2 adapters; llama.cpp b1-ff5ef82 Vulkan+SYCL, Intel llm-scaler-vllm:0.14.0-b8.1 Docker (vLLM FP8 pipeline-parallel). pp512/tg128, depth0, 3 runs/test mean, no prefix caching, q8_0 KV, FA on, 8k ctx. Per-request tg, NOT aggregate. Gemma 4 31B None, dual B70+B60 SYCL layer-split 31:23.
Measured by
third_party
Reproducible
yes
notes
pp512 163.5 tok/s prefill on dual B70+B60 SYCL layer-split 31:23.
Notes
pp512 163.5 tok/s prefill on dual B70+B60 SYCL layer-split 31:23.