M3 Max Llama 3.3 70B Q4_K - Medium prefill (llama.cpp, siliconscore ref)
59.5 tok/s (prompt eval)
Fields
id
benchmarks/m3max-llama-3-3-70b-q4-k-medium-llama-cpp-ctx16001-ppMetric
prefill_tok_s
Value
59.5
Unit
tok/s (prompt eval)
Model
Llama 3.3 70B
Methodology
Silicon Score benchmarks.csv reference run. M3 Max (GPU count not published, 64 GB): Llama 3.3 70B Q4_K - Medium via llama.cpp. context_tokens=16001. Prompt eval tok/s.
Measured by
third_party
Reproducible
yes
Thermal state
unknown
notes
siliconscore reference run; source_url=https://www.reddit.com/r/LocalLLaMA/comments/1he2v2n/speed_test_llama3370b_on_2xrtx3090_vs_m3max_64gb/.
Notes
siliconscore reference run; source_url=https://www.reddit.com/r/LocalLLaMA/comments/1he2v2n/speed_test_llama3370b_on_2xrtx3090_vs_m3max_64gb/.