Apple M2 Ultra (192GB) Llama-3.3-70B 4-bit decode (bandwidth-scaled estimate)
10.0 tok/s ESTIMATE - no direct measured row
Fields
id
benchmarks/comm-apple-m2-ultra-llama33-70b-4bit-decode-estMetric
decode_tok_s
Value
10
Unit
tok/s ESTIMATE - no direct measured row
Model
Llama-3.3-70B 4-bit
Methodology
ESTIMATED: 800 GB/s / ~40 GB-per-token read; midpoint of the 9-11 t/s range in the research file. Not a measured run - flagged est.
Measured by
third_party
Thermal state
unknown