Skip to content

Dataset · scholarweave

ArXiv LaTeX sources with metadata

scholarweave/arxiv-latex

The complete corpus of arXiv LaTeX sources, parsed and aligned with official metadata in Parquet format.

What's inside

This is the entire corpus of arXiv LaTeX sources, pre-parsed, formatted, and aligned with official metadata. The data is stored in query-ready Parquet files in English. The size ranges from 1 to 10 million records.

What you can do with it

  • Train text-generation models on scientific LaTeX texts
  • Perform feature extraction for arXiv papers
  • Build a search engine or parser for scientific articles
Tasks
Text generation, Embeddings
Languages
English
Size
1M–10M rows
Downloads this month
19.8K
Likes
150

Models trained on it

How to load it

from datasets import load_dataset

ds = load_dataset("scholarweave/arxiv-latex")