Llumnix: Dynamic Scheduling for Large Language Model Serving (arXiv 2406.03243)

Fields

id

sources/w3p-llumnix-osdi24-arxiv

URL

https://arxiv.org/abs/2406.03243

Publisher

arXiv

Kind

paper

Published

2024-06-05

Accessed

2026-10-04

notes

export.arxiv.org API id_list=2406.03243 returns 'Llumnix: Dynamic Scheduling for Large Language Model Serving', published 2024-06-05, arxiv:comment = "To appear at OSDI '24; open-source repo will be available in June 2024". Semantic Scholar venue 'USENIX Symposium on Operating Systems Design and Implementation', year 2024. OpenAlex institutions: Alibaba Group (China). The OSDI'24 USENIX proceedings page was not separately fetched, so the venue rests on the arXiv comment plus S2 agreement.

Notes

export.arxiv.org API id_list=2406.03243 returns 'Llumnix: Dynamic Scheduling for Large Language Model Serving', published 2024-06-05, arxiv:comment = "To appear at OSDI '24; open-source repo will be available in June 2024". Semantic Scholar venue 'USENIX Symposium on Operating Systems Design and Implementation', year 2024. OpenAlex institutions: Alibaba Group (China). The OSDI'24 USENIX proceedings page was not separately fetched, so the venue rests on the arXiv comment plus S2 agreement.

Cross-references

This record references no other records.