The Early Bird Catches the Leak: Unveiling Timing Side Channels in LLM Serving Systems

First demonstration that shared caches and GPU memory allocations create timing side channels from which an API caller can infer confidential SYSTEM PROMPTS and other users' requests.

paper

2024-09-30

2026-10-04