Huawei Atlas 300I Duo (96GB) Llama-3 decode - forum report
150.0 ~tok/s, multi-chip 96GB Duo - NOT a single-card figure
Fields
id
benchmarks/comm-ascend-300i-duo-llama3-70b-decodeMetric
decode_tok_s
Value
150
Unit
~tok/s, multi-chip 96GB Duo - NOT a single-card figure
Model
Llama-3 (70B-class)
Methodology
r/LocalLLaMA report; CANN/MindIE stack, multi-chip; no clean reproducible single-card number published
Measured by
third_party
Thermal state
unknown