Skip to content

Dataset · pixparse

UCSF documents with OCR annotations

pixparse/idl-wds

Millions of document pages with PDF, TIFF images, and OCR annotations for recognition training.

What's inside

The dataset is filtered from the UCSF document library: 19 million pages deemed valid. Each document includes a PDF, a TIFF image with the same content, a JSON with extensive Textract OCR annotations, and an .ocr file with old OCR markup. Modalities are image and text; language is not specified in metadata.

What you can do with it

  • Train an OCR model
  • Fine-tune a vision-language model for image-to-text
  • Evaluate text extraction from PDFs
Tasks
Image → text
Size
10M–100M rows
Downloads this month
16.9K
Likes
207

Models trained on it

How to load it

from datasets import load_dataset

ds = load_dataset("pixparse/idl-wds")