Skip to content

Dataset · mlfoundations

MINT-1T ArXiv scientific paper multimodal corpus

mlfoundations/MINT-1T-ArXiv

English interlaced text and image dataset from ArXiv scientific papers for pre-training.

What's inside

Part of the large-scale open MINT-1T dataset created by the University of Washington team for multimodal pre-training. This section gathers 1M to 10M English records extracted from ArXiv scientific papers and PDF documents featuring alternating text and illustrations (the entire MINT-1T project covers 1 trillion text tokens and 3.4 billion images).

What you can do with it

  • Pre-training multimodal language models (VLMs) on coherent text and illustrations
  • Training systems to understand scientific papers, charts, and complex PDF documents
  • Fine-tuning models for text generation grounded in visual context
Tasks
Image → text, Text generation
Languages
English
Size
1M–10M rows
Downloads this month
7K
Likes
61

How to load it

from datasets import load_dataset

ds = load_dataset("mlfoundations/MINT-1T-ArXiv")