M3 Max Llama 2 7B Q4_0 prefill (llama.cpp, siliconscore ref)
690.99 tok/s (prompt eval)
Fields
id
benchmarks/m3max-llama-2-7b-q4-0-llama-cpp-ctx512-ppMetric
prefill_tok_s
Value
690.99
Unit
tok/s (prompt eval)
Model
Llama 2 7B
Methodology
Silicon Score benchmarks.csv reference run. M3 Max (40-core GPU, 48 GB): Llama 2 7B Q4_0 via llama.cpp. context_tokens=512. Prompt eval tok/s.
Measured by
third_party
Reproducible
yes
Thermal state
unknown
notes
siliconscore reference run; source_url=https://github.com/ggml-org/llama.cpp/discussions/4167.
Notes
siliconscore reference run; source_url=https://github.com/ggml-org/llama.cpp/discussions/4167.