Apple M3 Max (64GB) llama.cpp: Llama-3.3-70B Q4_K_M decode @258 ctx
8.15 tok/s single-stream @ 258 ctx; falls to 6.13 @ 32k ctx
Fields
id
benchmarks/comm-apple-m3-max-llama33-70b-q4km-decode-258ctxMetric
decode_tok_s
Value
8.15
Unit
tok/s single-stream @ 258 ctx; falls to 6.13 @ 32k ctx
Model
Llama-3.3-70B Q4_K_M
Methodology
Silicon Score CSV row (source: r/LocalLLaMA 1he2v2n 2x3090-vs-M3Max comparison): llama.cpp, Q4_K_M, 64 GB M3 Max, pp 67.86 t/s, decode 8.15 t/s at 258-token context. Per-request batch-1.
Measured by
third_party
notes
Context-depth sweep on same row: 8.15 @258, 7.48 @8013, 7.0 @16001, 6.13 @32170 — 25% decode decay across 258->32k context, KV-cache bandwidth cost.
Notes
Context-depth sweep on same row: 8.15 @258, 7.48 @8013, 7.0 @16001, 6.13 @32170 — 25% decode decay across 258->32k context, KV-cache bandwidth cost.