Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Heads
paper
Fields
id
sources/niche-medusa-paperPublisher
arXiv
Kind
paper
Published
2024-01-19
Accessed
2026-10-03
notes
Medusa technical report. Primary source for the multi-head drafting mechanism that the original vLLM/SGLang n-gram and draft-model paths later replaced.
Notes
Medusa technical report. Primary source for the multi-head drafting mechanism that the original vLLM/SGLang n-gram and draft-model paths later replaced.
Cross-references
This record references no other records.