Skip to content

Dataset · lmsys

ToxicChat: toxic prompts

lmsys/toxic-chat

10K prompts from Vicuna demo with toxicity annotations for classification.

What's inside

ToxicChat contains toxicity annotations for 10K user prompts collected from online Vicuna demos. There is the toxicchat0124 version, updated OpenAI Moderation API results, and the official T5-Large baseline. The language is English, and modalities are text and tabular.

What you can do with it

  • Training a toxicity classifier
  • Evaluating chatbot moderation
  • Comparing with the T5-Large baseline
Tasks
Text classification
Languages
English
Size
10K–100K rows
Downloads this month
9.8K
Likes
215

Models trained on it

How to load it

from datasets import load_dataset

ds = load_dataset("lmsys/toxic-chat")