Skip to content

Dataset · cais

LLM hazardous knowledge & unlearning benchmark

cais/wmdp

English multiple-choice tests for evaluating models on dangerous domain knowledge and unlearning methods.

What's inside

The dataset is an English multiple-choice question set with a total volume ranging from 1,000 to 10,000 entries. The questions serve as a proxy indicator of hazardous knowledge across three critical areas: biosecurity, cybersecurity, and chemical security. Developed by CAIS.

What you can do with it

  • Auditing language models for potentially dangerous knowledge prior to release
  • Testing and comparing machine unlearning algorithms for safely erasing information from LLM weights
Tasks
Text generation
Languages
English
Size
1K–10K rows
Downloads this month
29.8K
Likes
32

Models trained on it

How to load it

from datasets import load_dataset

ds = load_dataset("cais/wmdp")