Skip to content

Datasets

Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.

Data type

For which models

Find a dataset for your goal

Answered by Gemini 4 · the chat is kept only in this tab

Datasetmlfoundations/MINT-1T-PDF-CC-2023-14

Multimodal PDF and web page corpus (MINT-1T part)

A slice of the ultra-large MINT-1T dataset of 1M to 10M records with interleaved English text and images.

  • Image → text
  • Text generation
  • English
22.9K 61M–10M rows
DatasetDefectSpectrum/Defect_Spectrum

Defect Spectrum industrial defects dataset

Benchmark for computer vision research and defect inspection applications.

  • Image segmentation
  • Image → text
  • English
22.8K 2910K–100K rows
Datasetflaviagiammarino/path-vqa

PathVQA: pathology visual question answering

Question-answer pairs on pathology images for training and evaluating medical VQA systems.

  • Visual question answering
  • English
22.5K 7710K–100K rows
Datasetjinlong17/CTVid-Bench

CTVid-Bench video text restoration benchmark

An ECCV 2026 test dataset for evaluating clear text restoration in video and VQA.

  • Visual question answering
  • Video classification
  • Chinese
  • English
22.3K 010K–100K rows
Datasetmorgan/CADExpert_fixed

CADExpert dataset of CAD tasks

14,935 unique CAD tasks with images and three expert answers each.

  • Image → text
  • English
  • Chinese
21.9K 110K–100K rows
DatasetHothan/OlympiadBench

Multimodal benchmark of Olympiad scientific problems

Complex Olympiad-level problems with images in English and Chinese for evaluating model scientific reasoning.

  • Question answering
  • Visual question answering
  • Chinese
  • English
21.8K 521K–10K rows
Datasetimageomics/VLM4Bio

VLM4Bio dataset for ornithology

Metadata and scripts for downloading bird images for visual question-answering tasks.

  • Visual question answering
  • Zero shot image classification
  • Zero shot object detection
  • English
21.6K 110K–100K rows
DatasetSimulaMet/Kvasir-VQA-x1

Medical dataset Kvasir-VQA-x1 for endoscopy

Multimodal dataset of 159,549 question-answer pairs for benchmarking in gastrointestinal endoscopy.

  • Visual question answering
  • Image text → text
  • English
21.6K 18100K–1M rows
Datasetyingss/mixlora-eval-data

MixLoRA multimodal eval dataset

Multimodal evaluation dataset and MME benchmark from the MixLoRA paper (ACL 2024).

  • Visual question answering
  • Image classification
  • English
21.6K 01K–10K rows
DatasetPaddlePaddle/Real5-OmniDocBench

Distorted document parsing benchmark

Document image set with physical distortions to test OCR and parsing system robustness.

  • Image → text
  • Chinese
  • English
21.5K 431K–10K rows
Datasetmlfoundations/MINT-1T-PDF-CC-2024-10Top pick

Multimodal PDF corpus for VLM pre-training

Part of the giant open MINT-1T dataset featuring interleaved English text and PDF images.

  • Image → text
  • Text generation
  • English
21.5K 51M–10M rows
Datasetgksriharsha/chitralekha

Large Telugu OCR dataset

Tens of millions of text image and transcript pairs for training Telugu optical character recognition systems.

  • Image → text
  • Telugu
21.5K 1110M–100M rows
Datasetjinlong666/IndustryBench-MIPU

Industry Document Specification Extraction Benchmark

A collection of Chinese technical tables and blueprint images for evaluating Multimodal Large Language Models (MLLMs).

  • Image → text
  • Visual question answering
  • Chinese
21.4K 110K–100K rows
DatasetVincent-HKUSTGZ/FragFake

AI Image Editing Detection Dataset via VQA

Image-text pairs for training multimodal models to detect image editing artifacts.

  • Visual question answering
  • English
20.9K 110K–100K rows
DatasetVincentHancoder/RAPTop pick

Scientific Papers and Posters with HTML Markup

25,435 triples of scientific papers, posters, and HTML/CSS templates from AI conferences for poster generation.

  • Image → text
  • Text → image
  • English
20.8K 310K–100K rows
Datasetyutongli2024/EgoExo-Next

EgoExo-Next benchmark for egocentric actions

Visual benchmark for egocentric-exocentric action understanding and future state prediction.

  • Visual question answering
  • Image → text
  • English
20.8K 010K–100K rows
Datasetmlfoundations/MINT-1T-PDF-CC-2023-23Top pick

MINT-1T multimodal corpus chunk (PDF and web data)

Part of a giant open dataset with interleaved texts and images from PDFs and the web.

  • Image → text
  • Text generation
  • English
20.6K 101M–10M rows
DatasetLeoFan01/RoboBench

RoboBench Benchmark for MLLM Robotics Evaluation

English multimodal test suite for checking how well vision-language models reason in robotics scenarios.

  • Robotics
  • Visual question answering
  • English
20.4K 7up to 1K rows
Datasetwendlerc/RenderedTextTop pick

12 million rendered handwriting texts on 3D paper

Synthetic dataset from Stability AI and LAION with English handwritten text images for OCR and generation.

  • Text → image
  • Image → text
  • English
20.3K 5910M–100M rows
DatasetIPEC-COMMUNITY/EO-Data1.5MTop pick

Multimodal dataset for robotics and embodied AI

Large-scale set of 1 to 10 million examples alternating images, text, and actions for training embodied AI.

  • Robotics
  • Visual question answering
  • Video text → text
  • English
20.3K 241M–10M rows
Datasetwebarena-x/webarena-infinity-trajectories

WebArena web agent trajectories

Dataset of successful browser agent trajectories with step-by-step screenshots and reasoning for agent training.

  • Visual question answering
  • Image → text
20.2K 210K–100K rows
Datasettaesiri/SteamScreenshots-Bugs

Steam screenshots with bugs for image-to-text

Array of Steam screenshots ranging from 100 thousand to 1 million examples for image description tasks.

  • Image → text
  • English
20K 2100K–1M rows