Efficient Memory Management for Large Language Model Serving with PagedAttention (SOSP 2023)
paper
Fields
id
sources/sched-vllm-pagedattention-sosp23Publisher
arXiv
Kind
paper
Published
2023-09
Accessed
2026-10-04
Archived URL
notes
vLLM/PagedAttention paper. Key result: 2-4x throughput improvement over state-of-the-art systems at the same latency. The arXiv abstract was fetched and verified.
Notes
vLLM/PagedAttention paper. Key result: 2-4x throughput improvement over state-of-the-art systems at the same latency. The arXiv abstract was fetched and verified.
Cross-references
This record references no other records.