An Embarrassingly Simple Detector for Model Extraction Attacks in Large Language Model API Traffic

Formulates extraction monitoring as benign-calibrated traffic-window distribution testing (MMD over a semantic embedding), thresholded from benign-vs-benign comparisons only. 0.3% benign FPR, 100% pure-attacker TPR, 90.5% average TPR over attacker fractions, 95.1% balanced accuracy, across 14 attacker-normal query pairs and three seeds.

paper

2026-06-04

2026-10-04