M3 Max llama-3-1-8b-instruct Q4_K - Medium TTFT (llamafile, siliconscore ref)
2725.7188864444443 ms (time to first token)
Fields
id
benchmarks/m3max-llama-3-1-8b-instruct-q4-k-medium-llamafile-ctxnp-ttftMetric
ttft_ms
Value
2,725.7189
Unit
ms (time to first token)
Model
llama-3-1-8b-instruct
Methodology
Silicon Score benchmarks.csv reference run. M3 Max (30-core GPU, 36 GB): llama-3-1-8b-instruct Q4_K - Medium via llamafile. context_tokens=not published. TTFT seconds.
Measured by
third_party
Reproducible
yes
Thermal state
unknown
notes
siliconscore reference run; source_url=https://www.localscore.ai/accelerator/805.
Notes
siliconscore reference run; source_url=https://www.localscore.ai/accelerator/805.