Dataset · taesiri
arXiv papers question and answer dataset
taesiri/arxiv_qa
English question-answer pairs based on arXiv scientific papers for training and evaluating QA systems.
What's inside
The dataset features automatically generated questions and answers from arXiv papers using large language models. It is in English with a volume of 100K to 1M examples. The format is not specified.
What you can do with it
- Fine-tune a QA model on scientific texts
- Evaluate retrieval and QA systems using arXiv papers
- Prepare an SFT assistant for working with scientific publications
- Tasks
- Question answering
- Languages
- English
- Size
- 100K–1M rows
- Downloads this month
- 1K
- Likes
- 139
Models trained on it
How to load it
from datasets import load_dataset
ds = load_dataset("taesiri/arxiv_qa")