Dataset · JonesLin
Corpus of scientific papers 2016-2021
JonesLin/writing-model-papers-2016-2021
Collection of open scientific texts and metadata from arXiv, CVF, NeurIPS, and other venues.
What's inside
The dataset contains metadata and documents (text, tabular data) of scientific articles published between 2016 and 2021 (2022 excluded). Sources are limited to open publications (arXiv, ACL Anthology, PMLR, etc.) within a 48 GB disk limit. Metadata are stored in JSONL format with title, year, authors, abstract, doi, and arxiv_id fields.
What you can do with it
- Training language models on scientific text
- Text summarization and information extraction tasks
- Tasks
- Text generation
- Languages
- English
- Size
- 10K–100K rows
- Downloads this month
- 45.5K
- Likes
- 0
How to load it
from datasets import load_dataset
ds = load_dataset("JonesLin/writing-model-papers-2016-2021")