Tesla M40 (Maxwell) has no INT8 DP4A - slower than the P40 it barely undercuts
[major] hardware
Fields
id
gotchas/gotcha-maxwell-m40-no-dp4a-slower-than-p40Class
hardware
Severity
major
Concepts
maxwelldp4aint8gguf
Symptom
M40 24GB at ~$189 looks like the cheapest 24GB card, but llama.cpp falls back to the FP32/CUDA-core path and it is SLOWER than a P40 despite similar VRAM.
Root cause
Maxwell CC5.2 predates both INT8 DP4A and tensor cores; GGUF Q4/Q8 INT8 path cannot engage, so the card decodes on FP32 CUDA cores.
Workaround
Only buy the M40 if ~$189 is truly the ceiling. Stretch to a P40 (~$110-280) for the DP4A path.