Selective KV-Cache Sharing to Mitigate Timing Side-Channels in LLM Inference (SafeKV)

Treats global KV-cache sharing as the cause and builds detection plus isolation into the runtime. Reports up to 40.58% lower TTFT than full isolation and up to 2.66x throughput. Its stated threat model is the scope limit on the whole isolate-everything approach.

paper

2025-08-11

2026-10-04