Skip to content

Dataset · PKU-Alignment

QA pairs with harm annotations

PKU-Alignment/BeaverTails

100K+ human-annotated QA pairs across 14 harm categories for AI safety.

What's inside

BeaverTails is an AI safety dataset collection. The repository features human annotations of question-answer pairs with harm category labels; a single pair may belong to multiple categories. It covers 14 categories, including animal abuse. Language is English, modality is text.

What you can do with it

  • Train a harmful response classifier
  • Test LLM safety filters
  • Create LoRA for refusing harmful prompts
Tasks
Text classification
Languages
English
Size
100K–1M rows
Downloads this month
21.8K
Likes
119

Models trained on it

How to load it

from datasets import load_dataset

ds = load_dataset("PKU-Alignment/BeaverTails")