arXiv:2310.07240 — CacheGen: KV Cache Compression and Streaming for Fast Large Language Model Serving

arXiv:2310.07240. v1 submitted 2023-10-11. Title on the /abs/ page confirmed as: "CacheGen: KV Cache Compression and Streaming for Fast Large Language Model Serving". Venue/year for the corresponding paper record come from the Semantic Scholar graph API; see that record's notes where the arXiv comment field or OpenReview was used instead.