JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Models (NeurIPS 2024 Datasets and Benchmarks)

Standardised jailbreak evaluation with a defined threat model, fixed system prompts and chat templates, 100 behaviours, and a leaderboard tracking attacks AND defences. Also ships an over-refusal dataset - the metric that makes the cost of an output filter measurable.

paper

2024-03-28

2026-10-04