Dataset · arxiv-community
1.7M arXiv papers for search and analysis
arxiv-community/arxiv_dataset
A corpus of 1.7 million English arXiv papers for recommendations, trend analysis, and semantic search.
What's inside
This is a dataset of 1.7 million English arXiv papers. It is proposed for trend analysis, recommender systems, category prediction, citation network construction, knowledge graphs, and semantic search. The format is not specified in the card.
What you can do with it
- Train a paper recommendation system
- Build semantic search over arXiv
- Evaluate models on category classification and summarization
- Tasks
- Translation, Summarization, Text retrieval
- Languages
- English
- Size
- 1M–10M rows
- Downloads this month
- 934
- Likes
- 139
Models trained on it
How to load it
from datasets import load_dataset
ds = load_dataset("arxiv-community/arxiv_dataset")