Skip to content

Dataset · gfissore

Abstracts of all arXiv papers through end of 2021

gfissore/arxiv-abstracts-2021

About 2 million titles, abstracts, and metadata of scientific papers from arXiv in English.

What's inside

The dataset collects metadata, including titles and abstracts, for all scientific publications on arXiv through the end of 2021—totaling about 2 million English records. Unlike alternative collections, this set does not require downloading external archives and is ready for use immediately.

What you can do with it

  • Training scientific text summarization and title generation models
  • Building semantic search systems, article recommendation, and topic classification
Tasks
Summarization, Text retrieval
Languages
English
Size
1M–10M rows
Downloads this month
6.4K
Likes
41

Models trained on it

How to load it

from datasets import load_dataset

ds = load_dataset("gfissore/arxiv-abstracts-2021")