Skip to content

Datasets

Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.

Data type

For which models

Find a dataset for your goal

Answered by Gemini 4 · the chat is kept only in this tab

DatasetzonghanHZH/ShowUI-web-8k

Web interface screenshots for training GUI agents

A curated selection of 8,000 English website screenshots for training models to understand web interface elements.

  • Image text → text
  • English
35.5K 01K–10K rows
Datasetlongvideobench/LongVideoBench

Long-video understanding benchmark up to 1 hour for LMMs

3,763 long captioned videos with questions to evaluate long-context multimodal models.

  • Multiple choice
  • Visual question answering
  • English
33.6K 641K–10K rows🔒 on request
Datasetwulin222/MME-Unify

MME-Unify benchmark for multimodal models

Evaluation set of images and English text across 10 tasks and 30 subtasks for testing U-MLLMs.

  • Multiple choice
  • Question answering
  • Visual question answering
  • English
32.7K 31K–10K rows
DatasetRuoliuYang/ulvr_subset

Visual Latent Reasoning Subsets (ULVR)

Curated subsets of 100k to 1M examples featuring images, dialogues, and precomputed teacher latents.

  • Visual question answering
  • Image → text
32.3K 0100K–1M rows
DatasetOitaaa/GDP.pdfTop pick

Complex operational PDF document analysis benchmark

100 real operational PDFs and related questions from 10 industries to evaluate multimodal document analysis.

  • Document question answering
31.6K 1up to 1K rows
Datasetderek-thomas/ScienceQA

ScienceQA: Scientific questions with images

A multimodal English science question dataset with multiple-choice options and images.

  • Multiple choice
  • Question answering
  • Other
  • English
31.3K 24410K–100K rows
Datasethiyouga/geometry3k

Geometric image-text VQA pairs

A VQA dataset with geometric diagram images and English text question-answer pairs, containing about 1 to 10k examples.

  • Visual question answering
  • English
30.6K 871K–10K rows
DatasetAlbertoChestnut/telugu-ocr

Telugu book scans and OCR text pairs

About 25.5 thousand pairs of scanned book pages and human-verified Telugu text from Wikisource.

  • Image → text
  • Telugu
30.5K 1100K–1M rows
DatasetVillanovaAI/Multi-CoSyn-400K

Multilingual synthetic document VQA dataset

100K to 1M question-answer pairs with reasoning over text-dense images across 5 European languages.

  • Visual question answering
  • Italian
  • English
  • German
  • +2
30.4K 0100K–1M rows🔒 on request
Datasetmultimodal-reasoning-lab/Zebra-CoT

Zebra-CoT visual reasoning chains

182k alternating text and image examples for step-by-step visual reasoning.

  • Multimodal
  • Image text → text
  • Visual question answering
29.9K 84100K–1M rows
Datasetapple/DataCompDR-1BTop pick

Apple synthetic captions and embeddings for DataComp-1B

Apple's extension of the DataComp-1B dataset with synthetic captions, embeddings, and metadata for image-text pairs.

  • Text → image
  • Image → text
  • English
29.4K 371B–10B rows
DatasetSilversorrow/SpineBench

Medical VQA benchmark for spine diseases

64,878 English QA pairs for 40,263 spine images to evaluate multimodal models.

  • Visual question answering
  • Multiple choice
  • English
29.2K 010K–100K rows
Datasetnyu-visionx/VSI-Bench

Video visual-spatial VQA benchmark

Video question-answering dataset for testing visual-spatial understanding in multimodal models.

  • Visual question answering
  • English
28.8K 7810K–100K rows
Datasetalibaba-multimodal-industrial-ai/IndustryBench-MIPU

Industrial product feature extraction benchmark

Image and Chinese text dataset for evaluating MLLMs in multi-image attribute extraction.

  • Image → text
  • Visual question answering
  • Chinese
27.9K 810K–100K rows
DatasetPawChrona/PawChrona-MMQA

Pet Health and Behavior Multimodal Q&A Dataset

49K English and Chinese questions about cats and dogs with images, audio, video, and text.

  • Visual question answering
  • Question answering
  • English
  • Chinese
27.4K 11100K–1M rows🔒 on request
DatasetBoKelvin/SLAKE

SLAKE Medical Visual Question Answering Dataset

Medical image dataset with questions, answers, and semantic annotations in English and Chinese.

  • Visual question answering
  • English
  • Chinese
26.8K 6510K–100K rows
DatasetMC7ever/hf-training-corpus

Multimodal HF Corpus of 92K Datasets

Large-scale extraction of texts, images, audio, and video from open datasets in a unified parquet format.

  • Text generation
  • Image → text
  • Automatic speech recognition
  • English
26.8K 1100K–1M rows
DatasetHuggingFaceM4/DocmatixTop pick

Documents and questions for Document VQA

Massive English dataset for Document VQA used in Idefics3 fine-tuning.

  • Visual question answering
  • English
26.8K 3191M–10M rows
DatasetRevolutionCrossroads/loc_chronicling_america_1770-1810

OCR Archive of 1770-1810 American Newspapers

Historical US newspaper pages with images, original OCR, and neural text recognition.

  • Image → text
  • Text retrieval
  • Text classification
  • English
26.6K 810K–100K rows
DatasetDesmondYMTang2024/Language-Grounded_Sparse_Encoder_Training

Generated images with person annotations for LanSE

Dataset of 100K–1M examples featuring AI-generated images and human annotations for interpreting and analyzing generative models.

  • Image classification
  • Image → text
  • English
26.3K 1100K–1M rows
DatasetLin-Chen/MMStar

Data-Leakage-Free Multimodal Benchmark

Curated English visual-text tasks for fair evaluation of large multimodal models.

  • Multiple choice
  • Question answering
  • Visual question answering
  • English
26.2K 551K–10K rows
Datasetmlfoundations/MINT-1T-PDF-CC-2023-50Top pick

MINT-1T: interleaved text and images from PDF and the web

Part of a massive 1 trillion token multimodal dataset for pre-training models in document and page understanding.

  • Image → text
  • Text generation
  • English
25.8K 141M–10M rows