arXiv:2401.18079 — KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization

Fields

id

sources/pap-quant-kvquant

URL

https://arxiv.org/abs/2401.18079

Publisher

arXiv

Kind

paper

Published

2024-01-31

Accessed

2026-10-03

notes

arXiv:2401.18079. v1 submitted 2024-01-31. Title on the /abs/ page confirmed as: "KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization". Venue/year for the corresponding paper record come from the Semantic Scholar graph API; see that record's notes where the arXiv comment field or OpenReview was used instead.

Notes

arXiv:2401.18079. v1 submitted 2024-01-31. Title on the /abs/ page confirmed as: "KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization". Venue/year for the corresponding paper record come from the Semantic Scholar graph API; see that record's notes where the arXiv comment field or OpenReview was used instead.

Cross-references

This record references no other records.