M1 Max 64GB llama-server b8139 GLM-4.7-Flash Q4_K_XL generation average
36.8 tok/s (average over the author's prompt set, ctx capped at 4096)
Fields
id
benchmarks/llamacpp-m1max64-glm47-flash-q4kxl-tg-avgMetric
decode_tok_s
Value
36.8
Unit
tok/s (average over the author's prompt set, ctx capped at 4096)
Model
GLM-4.7-Flash Q4_K_XL (unsloth, 16 GB on disk)
Methodology
llama-server on one MacBook Pro M1 Max, 64 GB unified memory (u/luke_pacman). llama.cpp build 8139, --flash-attn on, --ctx-size 4096, --n-parallel left at its default of 4 but the author served one prompt at a time, so the published averages are per-request, not a sum across concurrent slots. Prompt-eval tok/s is prefill of the test prompts; generation tok/s is decode. Exact prompt and output lengths are NOT printed — only that every run stayed inside the 4096 context cap and that the figure is an average over the same prompt set for all three models. Treat the absolute number as comparable across the three models and not as a pp512/tg128 cell.
Measured by
third_party
Reproducible
yes
notes
Per-request average, not aggregate. Prompt length is unpublished, so this is not a pp512 or tg128 cell and should not be ranked against llama-bench rows. Q4_K_XL has no format record in this repo, so format_id is null for those two models; IQ4_XS maps to gguf-iq4-xs.
Notes
Per-request average, not aggregate. Prompt length is unpublished, so this is not a pp512 or tg128 cell and should not be ranked against llama-bench rows. Q4_K_XL has no format record in this repo, so format_id is null for those two models; IQ4_XS maps to gguf-iq4-xs.