Skip to content

Datasets

Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.

Data type

For which models

Find a dataset for your goal

Answered by Gemini 4 · the chat is kept only in this tab

DatasetChilleD/WebHarborTop pick

Offline copies of 153 websites for GUI agent training

An environment of 153 real websites in Docker and 3,518 tasks with automated verification for training and evaluating web agents.

  • Image text → text
  • English
23.7K 6
DatasetRevolutionCrossroads/nara_revolutionary_war_pension_files_PDFs

NARA Revolutionary War pension files archive

10k to 100k digitized multi-page National Archives documents in English.

  • Image → text
  • Text retrieval
  • Text classification
  • English
23.6K 010K–100K rows
DatasetUCSC-VLAA/Recap-DataComp-1BTop pick

1B image-text pairs with re-captions

Large DataComp-1B image-text corpus with improved captions from LLaVA-1.5-LLaMA3-8B.

  • Zero shot classification
  • Text retrieval
  • Image → text
23.5K 2131B–10B rows
DatasetU4R/DocGenome

arXiv scientific article benchmark for multimodal LLMs

An English-language dataset based on 500 thousand arXiv research articles for training and evaluating document processing.

  • Question answering
  • Image → text
  • English
23.3K 191K–10K rows
DatasetOmniEdu/Omni-Edu

Omni-Edu Multimodal Dataset

Instructional dataset for educational tasks and multimodal learning.

  • Text generation
  • Question answering
  • Image text → text
  • English
  • Chinese
23K 010K–100K rows
Datasetmlfoundations/MINT-1T-PDF-CC-2023-14

Multimodal PDF and web page corpus (MINT-1T part)

A slice of the ultra-large MINT-1T dataset of 1M to 10M records with interleaved English text and images.

  • Image → text
  • Text generation
  • English
22.9K 61M–10M rows
DatasetYTxFSGAMERz/ARGUS_DATASET

ARGUS geospatial benchmark

Multi-domain benchmark for geospatial intelligence and computer vision.

  • Image classification
  • Zero shot image classification
  • Visual question answering
  • English
22.8K 0
DatasetDefectSpectrum/Defect_Spectrum

Defect Spectrum industrial defects dataset

Benchmark for computer vision research and defect inspection applications.

  • Image segmentation
  • Image → text
  • English
22.8K 2910K–100K rows
Datasetflaviagiammarino/path-vqa

PathVQA: pathology visual question answering

Question-answer pairs on pathology images for training and evaluating medical VQA systems.

  • Visual question answering
  • English
22.5K 7710K–100K rows
Datasetvyokky/GUI-360Top pick

AI agent action trajectories in office apps

Over 1.2M action steps, screenshots, and reasoning chains for training AI agents in Windows.

  • Image text → text
22.5K 221M–10M rows
Datasetjinlong17/CTVid-Bench

CTVid-Bench video text restoration benchmark

An ECCV 2026 test dataset for evaluating clear text restoration in video and VQA.

  • Visual question answering
  • Video classification
  • Chinese
  • English
22.3K 010K–100K rows
DatasetMCG-NJU/VideoChat3-LV116k

Long video analysis instructions (VideoChat3)

An English video-text instruction dataset for training models to understand long videos.

  • Video text → text
  • English
22.2K 151K–10K rows
Datasetmorgan/CADExpert_fixed

CADExpert dataset of CAD tasks

14,935 unique CAD tasks with images and three expert answers each.

  • Image → text
  • English
  • Chinese
22.1K 110K–100K rows
DatasetMINT-SJTU/RoboFAC-datasetTop pick

Robot manipulator error analysis video dataset

Over 10 thousand videos and 78 thousand QA pairs for training robots to detect and fix errors.

  • Video text → text
  • English
22K 810K–100K rows
Datasetckchaos/ChartDiff

ChartDiff chart pair comparison benchmark

Large-scale benchmark for comparative summarization of chart pairs by language models.

  • Summarization
  • Image text → text
  • Image → text
21.8K 01K–10K rows
DatasetHothan/OlympiadBench

Multimodal benchmark of Olympiad scientific problems

Complex Olympiad-level problems with images in English and Chinese for evaluating model scientific reasoning.

  • Question answering
  • Visual question answering
  • Chinese
  • English
21.8K 521K–10K rows
Datasetimageomics/VLM4Bio

VLM4Bio dataset for ornithology

Metadata and scripts for downloading bird images for visual question-answering tasks.

  • Visual question answering
  • Zero shot image classification
  • Zero shot object detection
  • English
21.6K 110K–100K rows
DatasetPaddlePaddle/Real5-OmniDocBench

Distorted document parsing benchmark

Document image set with physical distortions to test OCR and parsing system robustness.

  • Image → text
  • Chinese
  • English
21.6K 431K–10K rows
DatasetSimulaMet/Kvasir-VQA-x1

Medical dataset Kvasir-VQA-x1 for endoscopy

Multimodal dataset of 159,549 question-answer pairs for benchmarking in gastrointestinal endoscopy.

  • Visual question answering
  • Image text → text
  • English
21.6K 18100K–1M rows
Datasetyingss/mixlora-eval-data

MixLoRA multimodal eval dataset

Multimodal evaluation dataset and MME benchmark from the MixLoRA paper (ACL 2024).

  • Visual question answering
  • Image classification
  • English
21.6K 01K–10K rows
Datasetmlfoundations/MINT-1T-PDF-CC-2023-06Top pick

1-trillion token multimodal PDF and web corpus

A large-scale open corpus of interleaved English text and images for multimodal pre-training.

  • Image → text
  • Text generation
  • English
21.5K 10100B–1T rows
Datasetmlfoundations/MINT-1T-PDF-CC-2024-10Top pick

Multimodal PDF corpus for VLM pre-training

Part of the giant open MINT-1T dataset featuring interleaved English text and PDF images.

  • Image → text
  • Text generation
  • English
21.5K 51M–10M rows
Datasetgksriharsha/chitralekha

Large Telugu OCR dataset

Tens of millions of text image and transcript pairs for training Telugu optical character recognition systems.

  • Image → text
  • Telugu
21.5K 1110M–100M rows