Dataset · gfissore
Abstracts of all arXiv papers through end of 2021
gfissore/arxiv-abstracts-2021
About 2 million titles, abstracts, and metadata of scientific papers from arXiv in English.
What's inside
The dataset collects metadata, including titles and abstracts, for all scientific publications on arXiv through the end of 2021—totaling about 2 million English records. Unlike alternative collections, this set does not require downloading external archives and is ready for use immediately.
What you can do with it
- Training scientific text summarization and title generation models
- Building semantic search systems, article recommendation, and topic classification
- Tasks
- Summarization, Text retrieval
- Languages
- English
- Size
- 1M–10M rows
- Downloads this month
- 6.4K
- Likes
- 41
Models trained on it
- andreas122001/roberta-mixed-detectorText classification 9.3K
- andreas122001/roberta-academic-detectorText classification 848
- samratduttaofficial/WaterSheepZero shot classification 81
- akta-pro/d3-mini-multiZero shot classification 81
- mmetamong/ko-decision-roberta-largeText classification 73
- mmetamong/ko-decision-bge-m3Text classification 59
- ITLL/WaterSheepZero shot classification 33
- andreas122001/bloomz-560m-mixed-detectorText classification 30
How to load it
from datasets import load_dataset
ds = load_dataset("gfissore/arxiv-abstracts-2021")