GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers (Frantar et al.)

v2. Read for the explicit 2-bit and ternary extreme-regime claim and the '175B in ~4 GPU-hours' figure.