M5 Max 128GB mlx_lm: Qwen3-Coder-Next-8bit prefill at 64k (65545 prompt tokens)
1432.73 tok/s (single-request prefill, 65545 prompt tokens)
Fields
id
benchmarks/m5max128-mlx-qwen3-coder-next-8bit-64k-ppMetric
prefill_tok_s
Value
1,432.73
Unit
tok/s (single-request prefill, 65545 prompt tokens)
Model
Qwen3-Coder-Next-8bit
Methodology
mlx_lm.generate on one 14-inch MacBook Pro, M5 Max, 128 GB unified memory, 40-core GPU (u/cryingneko). Command: mlx_lm.generate --model <local path> --prompt "$(cat /tmp/prompt_<N>.txt)" --max-tokens 128. ONE request, batch size 1: the prompt-tokens-per-sec line is prefill of that single prompt and the generation-tokens-per-sec line is decode of that single completion. NOT aggregate. mlx-lm version not printed. Author states these replaced an earlier BatchGenerator run. Model path /Volumes/SSD/Models/Qwen3-Coder-Next-8bit. Prompt: 65545 tokens. Generation: 61 tokens. Peak memory: 92.605 GB. PREFILL of one request, not aggregate.
Measured by
third_party
Reproducible
yes
notes
Prompt tokens-per-sec line of the mlx_lm.generate stdout. 4k rows for this model were already filed from the siliconscore CSV (ss-m5max-128-*); this is the 64k context the CSV pass did not keep.
Notes
Prompt tokens-per-sec line of the mlx_lm.generate stdout. 4k rows for this model were already filed from the siliconscore CSV (ss-m5max-128-*); this is the 64k context the CSV pass did not keep.