verifiedhigh · 0.90updated 2026-10-03

IST-DASLab/marlin: FP16xINT4 LLM inference kernel

repo

Fields

sources/quant-marlin-repo

URL

Publisher

IST-DASLab

Kind

repo

Published

2024-01-17

Accessed

2026-10-03

notes

Mixed-precision 4-bit weight-only kernel; upstream README claims ~4x speedup up to batch 16-32.

Mixed-precision 4-bit weight-only kernel; upstream README claims ~4x speedup up to batch 16-32.

This record references no other records.