arXiv:2406.19707 — InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management

arXiv:2406.19707. v1 submitted 2024-06-28. Title on the /abs/ page confirmed as: "InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management". Venue/year for the corresponding paper record come from the Semantic Scholar graph API; see that record's notes where the arXiv comment field or OpenReview was used instead.