MiniMax Sparse Attention (arXiv:2606.13392, MiniMax-AI) - authors' own technical report for the MiniMax-M3 model card

FETCHED AND READ 2026-10-08 (https://arxiv.org/abs/2606.13392 and the full HTML v2 at https://arxiv.org/html/2606.13392v2). 30 pages, 14 figures, submitted 11 Jun 2026, revised 12 Jun 2026 (v2). Authors Xunhao Lai, Weiqi Xu, Yufeng Yang et al. (17 authors). Abstract states: 'On a 109B-parameter model with native multimodal training, MSA performs on par with GQA while reducing per-token attention compute by 28.4x at 1M context. Paired with our co-designed kernel, MSA achieves 14.2x prefill and 7.6x decoding wall-clock speedups on H800.' The paper's own link is to the released production model: huggingface.co/MiniMaxAI/MiniMax-M3, whose card links back to this arXiv id - so this is the authors' report on the model that MINIMAX-M3 IS, not a third-party study of it. Section 5.1 Evaluation names the suite and Table 5 (the authors' own table) reports the matched-checkpoint comparison Full vs MSA-PT vs MSA-CPT on a 109B model: MMLU 67.0/67.2/66.8, MMLU-Pro 38.5/38.8/39.1, BBH 67.7/66.6/66.1, GPQA HARD 25.9/26.3/26.3, ARC-C 82.7/82.5/82.9, TriviaQA 66.0/65.5/67.7, WinoGrande 58.3/60.9/62.0, GSM8K 76.2/77.7/73.7, MGSM 44.1/46.0/44.2, MathVista 43.8/46.8/44.5, OlymMATH Easy P@100 23.0/26.0/22.0, HumanEval 61.0/64.0/57.9, EvalPlus 59.4/61.8/60.0, BigCodeBench 44.8/44.0/45.7, MultiPL-E MBPP P@10 82.1/81.6/81.1, RULER-8K 79.8/84.2/77.2, RULER-32K 75.0/77.5/75.7, plus image (AI2D, ChartQA, MMMU, OCRBench v2, CharXiv, VisualWebBench, CVBench) and video (EgoSchema, LongVideoBench) rows. THE NEGATIVE, WHICH IS THE REASON A DEDICATED GOTCHA RECORD EXISTS: this report does NOT publish GPQA DIAMOND, AIME, MATH-500 or any per-benchmark PostTrainBench decomposition, and the MiniMax-M3 model card's benchmark.jpeg (transcribed 2026-10-08) contains no GPQA Diamond row either - its closest row is PostTrainBench 37.1 for MiniMax M3, whose methodology footnote names GPQA Main as one of five benchmarks aggregated over 4 base models with an LLM-as-judge, which is not GPQA Diamond and not a model-card number for this model. A 109B/428B multi-modal checkpoint evaluated in an internal framework under matched training budgets is also not the same measurement as a 428B served checkpoint scored against an official API by one external harness. So a Tier-A vendor document EXISTS for the MiniMax-M3 family and its authors' own reported quality - and it does not contain the specific number the record holds.