LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding (arXiv:2404.16710)

arXiv:2404.16710. LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding. By Mostafa Elhoushi et al. (Meta). Submitted 2024-04-25. Enables early exit inference and self-speculative decoding by skipping layers. 2026-10-10: Fetched https://arxiv.org/abs/2404.16710. Title: 'LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding'. Peer-reviewed venue confirmed: ACL 2024. Abstract confirms layer dropout during training enabling early exit inference and self-speculative decoding.