Dataset · allenai
Qualitative Relationships Multiple Choice Questions (QuaRTz)
allenai/quartz
3,864 English multiple-choice questions for evaluating qualitative reasoning.
What's inside
The crowd-sourced QuaRTz text dataset from AllenAI in English includes 3,864 multiple-choice questions from an open domain. Each question is linked to one of 405 background sentences or short paragraphs describing qualitative relationships.
What you can do with it
- Benchmarking language models on logical reasoning and context understanding
- Fine-tuning (SFT) models for question-answering (QA) retrieval systems
- Tasks
- Question answering
- Languages
- English
- Size
- 1K–10K rows
- Downloads this month
- 21.8K
- Likes
- 11
Models trained on it
- jaredpalmer/kev-27bText classification 3.4K
- mradermacher/kev-27b-GGUFMultiple choice 1.6K
- mradermacher/elf-1-12b-GGUF 737
- mradermacher/elf-1-31b-GGUF 710
- littlemex/prismyra-decision-35b-a3b-fp8Text classification 556
- littlemex/prismyra-decision-35b-a3b-nvfp4Text classification 130
- arcbright/elf-1-12bText classification 104
- samratduttaofficial/WaterSheepZero shot classification 81
How to load it
from datasets import load_dataset
ds = load_dataset("allenai/quartz")