MuxServe: Flexible Spatial-Temporal Multiplexing for Multiple LLM Serving (arXiv 2404.02015)

Fields

id

sources/pap-sys-muxserve-arxiv

URL

https://arxiv.org/abs/2404.02015

Publisher

arXiv (Peking University)

Kind

paper

Published

2024-04-02

Accessed

2026-10-03

notes

arXiv cats cs.DC, no venue in comment. Venue verified on OpenReview: content.venue = 'ICML 2024 Poster' / 'ICML 2024'. (The OpenReview title reads 'MuxServe: Flexible Multiplexing for Efficient Multiple LLM Serving'.)

Notes

arXiv cats cs.DC, no venue in comment. Venue verified on OpenReview: content.venue = 'ICML 2024 Poster' / 'ICML 2024'. (The OpenReview title reads 'MuxServe: Flexible Multiplexing for Efficient Multiple LLM Serving'.)

Cross-references

This record references no other records.