r/LocalLLaMA: M4 Max llama.cpp Qwen3.5-35B-A3B and 27B sweep (post 1rlyukb)

Fields

id

sources/reddit-localllama-1rlyukb-m4-max-qwen35-llamacpp

URL

https://www.reddit.com/r/LocalLLaMA/comments/1rlyukb/m4_max_llamacpp_benchmarks_of_qwen35_35b_and_27b/

Publisher

Reddit r/LocalLLaMA

Kind

forum

Published

2026-03-05

Accessed

2026-10-17

notes

u/pmttyji, 2026-03-05. Self-reported llama.cpp llama-bench runs on one M4 Max MacBook Pro, 128 GB unified memory. Build b8353 (commit 28955214d, 2026-03-04), Metal backend, macOS. Command line printed: llama-bench -m <gguf> -fa 1 -d 0,8192 -p 512 -n 128 -ngl 99 -t 12. Per-request, one prompt. Forum, single author, numbers copied from llama-bench stdout rather than a screenshot.

Notes

u/pmttyji, 2026-03-05. Self-reported llama.cpp llama-bench runs on one M4 Max MacBook Pro, 128 GB unified memory. Build b8353 (commit 28955214d, 2026-03-04), Metal backend, macOS. Command line printed: llama-bench -m <gguf> -fa 1 -d 0,8192 -p 512 -n 128 -ngl 99 -t 12. Per-request, one prompt. Forum, single author, numbers copied from llama-bench stdout rather than a screenshot.

Cross-references

This record references no other records.