r/LocalLLaMA: M5 Max 128GB mlx_lm.generate sweep (cryingneko, post 1rqnpvj)

Fields

id

sources/reddit-localllama-1rqnpvj-m5-max-128gb-mlx-lm-sweep

URL

https://www.reddit.com/r/LocalLLaMA/comments/1rqnpvj/m5_max_just_arrived_benchmarks_incoming/

Publisher

Reddit r/LocalLLaMA

Kind

forum

Published

2026-03-11

Accessed

2026-10-17

notes

u/cryingneko, 14-inch MacBook Pro, M5 Max, 128 GB unified memory, 18-core CPU, 40-core GPU. Numbers pasted from mlx_lm.generate stdout (Prompt: N tokens, X tokens-per-sec / Generation: M tokens, Y tokens-per-sec / Peak memory). Author discarded an earlier BatchGenerator run and re-ran under a fresh venv with stream_generate; only the stream_generate numbers are in the post. Hardware Corner's 2026-03-11 writeup rounds these same numbers; this source is the unrounded original. Forum, single self-report.

Notes

u/cryingneko, 14-inch MacBook Pro, M5 Max, 128 GB unified memory, 18-core CPU, 40-core GPU. Numbers pasted from mlx_lm.generate stdout (Prompt: N tokens, X tokens-per-sec / Generation: M tokens, Y tokens-per-sec / Peak memory). Author discarded an earlier BatchGenerator run and re-ran under a fresh venv with stream_generate; only the stream_generate numbers are in the post. Hardware Corner's 2026-03-11 writeup rounds these same numbers; this source is the unrounded original. Forum, single self-report.

Cross-references

This record references no other records.