Skip to content

Dataset · JonesLin

Corpus of scientific papers 2016-2021

JonesLin/writing-model-papers-2016-2021

Collection of open scientific texts and metadata from arXiv, CVF, NeurIPS, and other venues.

What's inside

The dataset contains metadata and documents (text, tabular data) of scientific articles published between 2016 and 2021 (2022 excluded). Sources are limited to open publications (arXiv, ACL Anthology, PMLR, etc.) within a 48 GB disk limit. Metadata are stored in JSONL format with title, year, authors, abstract, doi, and arxiv_id fields.

What you can do with it

  • Training language models on scientific text
  • Text summarization and information extraction tasks
Tasks
Text generation
Languages
English
Size
10K–100K rows
Downloads this month
45.5K
Likes
0

How to load it

from datasets import load_dataset

ds = load_dataset("JonesLin/writing-model-papers-2016-2021")