Dataset · allenai
Benchmark for causal text understanding
allenai/ropes
English questions and answers to test the ability to apply rules from context to new situations.
What's inside
Contains causal relationship descriptions, new situations based on them, and questions about potential consequences. The English dataset size ranges from 10,000 to 100,000 examples. Created by Allen Institute for AI (allenai).
What you can do with it
- Evaluating reasoning skills in language models
- Fine-tuning models for reading comprehension and context-based question answering
- Tasks
- Question answering
- Languages
- English
- Size
- 10K–100K rows
- Downloads this month
- 3.4K
- Likes
- 51
Models trained on it
How to load it
from datasets import load_dataset
ds = load_dataset("allenai/ropes")