arXiv:2410.21465 — ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference

arXiv:2410.21465. v1 submitted 2024-10-28. Title on the /abs/ page confirmed as: "ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference". Venue/year for the corresponding paper record come from the Semantic Scholar graph API; see that record's notes where the arXiv comment field or OpenReview was used instead.