Dataset · scholarweave
ArXiv LaTeX sources with metadata
scholarweave/arxiv-latex
The complete corpus of arXiv LaTeX sources, parsed and aligned with official metadata in Parquet format.
What's inside
This is the entire corpus of arXiv LaTeX sources, pre-parsed, formatted, and aligned with official metadata. The data is stored in query-ready Parquet files in English. The size ranges from 1 to 10 million records.
What you can do with it
- Train text-generation models on scientific LaTeX texts
- Perform feature extraction for arXiv papers
- Build a search engine or parser for scientific articles
- Tasks
- Text generation, Embeddings
- Languages
- English
- Size
- 1M–10M rows
- Downloads this month
- 19.8K
- Likes
- 150
Models trained on it
How to load it
from datasets import load_dataset
ds = load_dataset("scholarweave/arxiv-latex")