r/LocalLLaMA: three ~30B MoE models on M1 Max 64GB (post 1rdx2c7)
forum
Fields
id
sources/reddit-localllama-1rdx2c7-m1-max-30b-moe-llama-serverPublisher
Reddit r/LocalLLaMA
Kind
forum
Published
2026-02-26
Accessed
2026-10-17
notes
u/luke_pacman, 2026-02-26. MacBook Pro M1 Max, 64 GB. llama-server build 8139, --flash-attn on, --ctx-size 4096, default --n-parallel 4. Three models served one at a time: GLM-4.7-Flash Q4_K_XL (unsloth), Nemotron-3-Nano-30B-A3B Q4_K_XL (unsloth), Qwen3-Coder-30B-A3B IQ4_XS (unsloth). Speed table gives prompt-eval and generation averages over the same prompt set. Forum, single self-report; the prompt set size and exact prompt lengths are not printed, only the context cap and the averages.
Notes
u/luke_pacman, 2026-02-26. MacBook Pro M1 Max, 64 GB. llama-server build 8139, --flash-attn on, --ctx-size 4096, default --n-parallel 4. Three models served one at a time: GLM-4.7-Flash Q4_K_XL (unsloth), Nemotron-3-Nano-30B-A3B Q4_K_XL (unsloth), Qwen3-Coder-30B-A3B IQ4_XS (unsloth). Speed table gives prompt-eval and generation averages over the same prompt set. Forum, single self-report; the prompt set size and exact prompt lengths are not printed, only the context cap and the averages.
Cross-references
This record references no other records.