Apple M2 Max (38c, 96GB) MLX: Qwen3.5-27B 8-bit decode
12.0 tok/s (MLX, 8-bit, per-request)
Fields
id
benchmarks/comm-m2-max-38c-96gb-qwen35-27b-8bit-mlx-decodeMetric
decode_tok_s
Value
12
Unit
tok/s (MLX, 8-bit, per-request)
Model
Qwen3.5-27B 8bit
Methodology
Silicon Score CSV row sourced to r/LocalLLaMA 1rkkeqh: MLX runtime, 8bit, ~30 GB RAM footprint, M2 Max 38-core 96 GB. Per-request batch-1.
Measured by
third_party