Robust Distortion-free Watermarks for Language Models (Kuditipudi et al.)

Distribution-preserving watermarks via inverse transform sampling and exponential minimum sampling. On OPT-1.3B and LLaMA-7B detects at p<=0.01 from 35 tokens after corrupting 40-50% of tokens. Crucially, the Alpaca-7B case study on RESPONSES to user instructions finds ~25% of responses undetectable because those responses are low-entropy.

paper

2023-07-28

2026-10-04