inference/research
verifiedlow · 0.60updated 2026-10-15

localscore.ai — measured llamafile/llama.cpp tok/s per accelerator page

database

Fields

id
sources/localscore-ai-accelerator-benchmark-pages
Publisher
LocalScore
Kind
database
Accessed
2026-10-15
notes
Machine-level measured tok/s database; rows cited via siliconscore.com benchmarks.csv export which links out to localscore.ai/accelerator/<id> pages. llamafile runner, Q4_K_M models (llama-3.1-8b-instruct, llama-3.2-1b-instruct, qwen-2.5-14b-instruct), prompt-eval tok/s and avg generation tok/s. Per-request, batch-1.

Notes

Machine-level measured tok/s database; rows cited via siliconscore.com benchmarks.csv export which links out to localscore.ai/accelerator/<id> pages. llamafile runner, Q4_K_M models (llama-3.1-8b-instruct, llama-3.2-1b-instruct, qwen-2.5-14b-instruct), prompt-eval tok/s and avg generation tok/s. Per-request, batch-1.

Cross-references

This record references no other records.