inference/research
verifiedmedium · 0.70updated 2026-10-17

llama.cpp b7083 Vulkan: gpt-oss-20b-Q8_0 prefill 1024 tok on intel-arc-b580

1041.18 tok/s (single-request prefill, 1024 prompt tokens)

Fields

id
benchmarks/phx-vk-b7083-b580-gptoss20b-pp1024
Metric
prefill_tok_s
Value
1,041.18
Unit
tok/s (single-request prefill, 1024 prompt tokens)
Model
gpt-oss-20b-Q8_0
Methodology
Phoronix Test Suite run of llama.cpp b7083 with the Vulkan backend, one shared host (Michael Larabel, 2025-12-08, result 2512070-NE-LLAMACPPV90). Intel Arc B580 on Mesa 26.0-dev ANV, AMD Radeon cards on Mesa 26.0-dev RADV, both under Linux 6.18. Geometric mean of N=3 runs. ONE request: the prompt-processing test prefills a single prompt and the text-generation test decodes a single 128-token completion. NOT an aggregate across concurrent requests. Batch size is the Phoronix llama.cpp default of 1 for these two tests. Quantization is Q8_0 as named in the result title. Power, clocks and thermals were not published. Card: intel-arc-b580. Model: gpt-oss-20b-Q8_0. PREFILL of one request, prompt-processing-1024 test, not aggregate.
Measured by
third_party
Reproducible
yes
notes
gpt-oss-20b-Q8_0 chart omits the RTX 5070 (it does not finish the run on that card in this result); the three cards filed here all completed. MoE decode, so the tok/s is not comparable to the dense 7B/8B rows above.

Notes

gpt-oss-20b-Q8_0 chart omits the RTX 5070 (it does not finish the run on that card in this result); the three cards filed here all completed. MoE decode, so the tok/s is not comparable to the dense 7B/8B rows above.

Cross-references