Skip to content

Dataset · taesiri

arXiv papers question and answer dataset

taesiri/arxiv_qa

English question-answer pairs based on arXiv scientific papers for training and evaluating QA systems.

What's inside

The dataset features automatically generated questions and answers from arXiv papers using large language models. It is in English with a volume of 100K to 1M examples. The format is not specified.

What you can do with it

  • Fine-tune a QA model on scientific texts
  • Evaluate retrieval and QA systems using arXiv papers
  • Prepare an SFT assistant for working with scientific publications
Tasks
Question answering
Languages
English
Size
100K–1M rows
Downloads this month
1K
Likes
139

Models trained on it

How to load it

from datasets import load_dataset

ds = load_dataset("taesiri/arxiv_qa")