Skip to content

Dataset · bench-llm

OR-Bench language model over-refusal benchmark

bench-llm/or-bench

A prompt set to check the balance between LLM safety and their tendency to refuse harmless prompts.

What's inside

An English dataset ranging from 10 to 100 thousand examples, including text and visual data (including the OR-Bench-Hard-1K and OR-Bench-Toxic subsets). It measures the model's refusal rate on both genuinely toxic queries and complex yet safe prompts.

What you can do with it

  • Test LLMs for excessive censorship and false refusals (over-refusal)
  • Calibrate alignment settings and safety filters before model release
Tasks
Text generation, Question answering
Languages
English
Size
10K–100K rows
Downloads this month
21.7K
Likes
26

Models trained on it

How to load it

from datasets import load_dataset

ds = load_dataset("bench-llm/or-bench")