Dataset · mlfoundations
MINT-1T ArXiv scientific paper multimodal corpus
mlfoundations/MINT-1T-ArXiv
English interlaced text and image dataset from ArXiv scientific papers for pre-training.
What's inside
Part of the large-scale open MINT-1T dataset created by the University of Washington team for multimodal pre-training. This section gathers 1M to 10M English records extracted from ArXiv scientific papers and PDF documents featuring alternating text and illustrations (the entire MINT-1T project covers 1 trillion text tokens and 3.4 billion images).
What you can do with it
- Pre-training multimodal language models (VLMs) on coherent text and illustrations
- Training systems to understand scientific papers, charts, and complex PDF documents
- Fine-tuning models for text generation grounded in visual context
- Tasks
- Image → text, Text generation
- Languages
- English
- Size
- 1M–10M rows
- Downloads this month
- 7K
- Likes
- 61
How to load it
from datasets import load_dataset
ds = load_dataset("mlfoundations/MINT-1T-ArXiv")