inference/research
verifiedhigh · 0.90updated 2026-10-03

Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Heads

paper

Fields

id
sources/niche-medusa-paper
Publisher
arXiv
Kind
paper
Published
2024-01-19
Accessed
2026-10-03
notes
Medusa technical report. Primary source for the multi-head drafting mechanism that the original vLLM/SGLang n-gram and draft-model paths later replaced.

Notes

Medusa technical report. Primary source for the multi-head drafting mechanism that the original vLLM/SGLang n-gram and draft-model paths later replaced.

Cross-references

This record references no other records.