M3 Max llama-3-1-8b-instruct Q4_K - Medium prefill (llamafile, siliconscore ref)
443.4985221666666 tok/s (prompt eval)
Fields
id
benchmarks/m3max-llama-3-1-8b-instruct-q4-k-medium-llamafile-ctxnp-ppMetric
prefill_tok_s
Value
443.4985
Unit
tok/s (prompt eval)
Model
llama-3-1-8b-instruct
Methodology
Silicon Score benchmarks.csv reference run. M3 Max (30-core GPU, 36 GB): llama-3-1-8b-instruct Q4_K - Medium via llamafile. context_tokens=not published. Prompt eval tok/s.
Measured by
third_party
Reproducible
yes
Thermal state
unknown
notes
siliconscore reference run; source_url=https://www.localscore.ai/accelerator/805.
Notes
siliconscore reference run; source_url=https://www.localscore.ai/accelerator/805.