Skip to content

Dataset · arxiv-community

1.7M arXiv papers for search and analysis

arxiv-community/arxiv_dataset

A corpus of 1.7 million English arXiv papers for recommendations, trend analysis, and semantic search.

What's inside

This is a dataset of 1.7 million English arXiv papers. It is proposed for trend analysis, recommender systems, category prediction, citation network construction, knowledge graphs, and semantic search. The format is not specified in the card.

What you can do with it

  • Train a paper recommendation system
  • Build semantic search over arXiv
  • Evaluate models on category classification and summarization
Tasks
Translation, Summarization, Text retrieval
Languages
English
Size
1M–10M rows
Downloads this month
934
Likes
139

Models trained on it

How to load it

from datasets import load_dataset

ds = load_dataset("arxiv-community/arxiv_dataset")