inference/research
verifiedhigh · 0.90updated 2026-10-04

PrefixWall: Mitigating Prefix Caching Side Channels in Shared LLM Systems

paper

Fields

id
sources/sec-arxiv-2603-10726
URL
https://arxiv.org/abs/2603.10726
Publisher
Characterises current defences as a sledgehammer - disable automatic prefix caching and cross-user cache sharing, isolating users at the cost of efficiency for regular users. That framing is the useful part for a serving engineer: the isolation/efficiency trade is explicit and currently resolved badly.
Kind
paper
Published
2026-03-11
Accessed
2026-10-04

Cross-references

This record references no other records.