rapid-mlx eval scorecard: 17 MLX models on Apple M3 Ultra 256GB (2026-03-05)

Fields

id

sources/rapid-mlx-scorecard-m3-ultra-2026-03-05

URL

https://github.com/raullenchai/Rapid-MLX/blob/main/evals/SCORECARD.md

Publisher

raullenchai (rapid-mlx)

Kind

benchmark

Published

2026-03-05

Accessed

2026-10-17

notes

Auto-generated scorecard dated 2026-03-05 00:32 UTC, tested on Apple M3 Ultra 256GB. Server is rapid-mlx (the project formerly named vllm-mlx) serving MLX models with an OpenAI-compatible API. The README section of the same evals directory defines the protocol; the per-model blocks print cold and warm TTFT and two decode rates (short and long). enable_thinking was false and the cache was cleared between suites. The r/LocalLLaMA summary post 1rkcvqa quotes only the long decode figure and rounds it; these records use the scorecard.

Notes

Auto-generated scorecard dated 2026-03-05 00:32 UTC, tested on Apple M3 Ultra 256GB. Server is rapid-mlx (the project formerly named vllm-mlx) serving MLX models with an OpenAI-compatible API. The README section of the same evals directory defines the protocol; the per-model blocks print cold and warm TTFT and two decode rates (short and long). enable_thinking was false and the cache was cleared between suites. The r/LocalLLaMA summary post 1rkcvqa quotes only the long decode figure and rounds it; these records use the scorecard.

Cross-references

This record references no other records.