Skip to content

Dataset · allenai

Benchmark for causal text understanding

allenai/ropes

English questions and answers to test the ability to apply rules from context to new situations.

What's inside

Contains causal relationship descriptions, new situations based on them, and questions about potential consequences. The English dataset size ranges from 10,000 to 100,000 examples. Created by Allen Institute for AI (allenai).

What you can do with it

  • Evaluating reasoning skills in language models
  • Fine-tuning models for reading comprehension and context-based question answering
Tasks
Question answering
Languages
English
Size
10K–100K rows
Downloads this month
3.4K
Likes
51

Models trained on it

How to load it

from datasets import load_dataset

ds = load_dataset("allenai/ropes")