Skip to content

Datasets

Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.

Data type

For which models

Find a dataset for your goal

Answered by Gemini 4 · the chat is kept only in this tab

DatasetARTPARK-IISc/VaaniTop pick

Vaani Indian multilingual speech

31k hours of image-prompted spontaneous speech across 105 Indian languages, with transcripts for ASR and multimodal tasks.

  • Automatic speech recognition
  • Text → speech
  • Image → text
  • Nepali
  • Assamese
  • Malayalam
  • +9
37K 19810M–100M rows🔒 on request
DatasetzonghanHZH/ShowUI-web-8k

Web interface screenshots for training GUI agents

A curated selection of 8,000 English website screenshots for training models to understand web interface elements.

  • Image text → text
  • English
35.5K 01K–10K rows
DatasetServiceNow/GroundCUATop pick

Interface screenshots and annotations for AI agents

A large-scale corpus of screenshots from 87 applications with structured annotations for training computer-controlling agents.

  • Image → text
  • English
34.2K 461M–10M rows
DatasetMike33/PolyChartQA

Multilingual chart QA benchmark

Test set of 10K-100K chart examples with generation code and questions in 10 languages for VLM evaluation.

  • Visual question answering
  • Arabic
  • Bangla
  • English
  • +7
34K 010K–100K rows
DatasetDesmondYMTang2024/Language-Grounded_Sparse_Encoder_Training

Generated images with person annotations for LanSE

Dataset of 100K–1M examples featuring AI-generated images and human annotations for interpreting and analyzing generative models.

  • Image classification
  • Image → text
  • English
33.6K 1100K–1M rows
Datasetlongvideobench/LongVideoBench

Long-video understanding benchmark up to 1 hour for LMMs

3,763 long captioned videos with questions to evaluate long-context multimodal models.

  • Multiple choice
  • Visual question answering
  • English
33.6K 641K–10K rows🔒 on request
Datasetmlfoundations/dcvlm_pool_mediumTop pick

Huge raw data pool for VLM training (483M)

Unfiltered 41.1 TB multimodal corpus in six languages for VLM data curation experiments.

  • Image text → text
  • Visual question answering
  • English
  • Chinese
  • German
  • +9
32.8K 0100M–1B rows
Datasetwulin222/MME-Unify

MME-Unify benchmark for multimodal models

Evaluation set of images and English text across 10 tasks and 30 subtasks for testing U-MLLMs.

  • Multiple choice
  • Question answering
  • Visual question answering
  • English
32.7K 31K–10K rows
DatasetRuoliuYang/ulvr_subset

Visual Latent Reasoning Subsets (ULVR)

Curated subsets of 100k to 1M examples featuring images, dialogues, and precomputed teacher latents.

  • Visual question answering
  • Image → text
32.7K 0100K–1M rows
Datasetmlfoundations/dcvlm_pool_smallTop pick

121M Example Raw Pool for VLM Data Curation

Unfiltered 10.3 TB corpus from 166 sources for VLM data filtering experiments.

  • Image text → text
  • Visual question answering
  • English
  • Chinese
  • German
  • +9
32.6K 0100M–1B rows
DatasetOitaaa/GDP.pdfTop pick

Complex operational PDF document analysis benchmark

100 real operational PDFs and related questions from 10 industries to evaluate multimodal document analysis.

  • Document question answering
31.8K 1up to 1K rows
DatasetJingyuSun/counterfactual-vlm-benchmark-data

Counterfactual VLM benchmark data

Dataset for benchmarking counterfactual vision-language models (VLMs).

  • Visual question answering
31.7K 2
Datasetderek-thomas/ScienceQA

ScienceQA: Scientific questions with images

A multimodal English science question dataset with multiple-choice options and images.

  • Multiple choice
  • Question answering
  • Other
  • English
31.3K 24410K–100K rows
Datasethiyouga/geometry3k

Geometric image-text VQA pairs

A VQA dataset with geometric diagram images and English text question-answer pairs, containing about 1 to 10k examples.

  • Visual question answering
  • English
30.6K 871K–10K rows
DatasetAlbertoChestnut/telugu-ocr

Telugu book scans and OCR text pairs

About 25.5 thousand pairs of scanned book pages and human-verified Telugu text from Wikisource.

  • Image → text
  • Telugu
30.5K 1100K–1M rows
DatasetKRAFTON/VLM-SubtleBenchTop pick

VLM fine-grained visual comparison benchmark

A collection of images and English questions to test VLM ability to find subtle differences in similar pictures.

  • Visual question answering
  • Image → text
  • English
29.9K 710K–100K rows
Datasetmultimodal-reasoning-lab/Zebra-CoT

Zebra-CoT visual reasoning chains

182k alternating text and image examples for step-by-step visual reasoning.

  • Multimodal
  • Image text → text
  • Visual question answering
29.9K 84100K–1M rows
Datasetmlfoundations/MINT-1T-PDF-CC-2023-40Top pick

Chunk of the massive MINT-1T multimodal corpus (PDF)

Part of the open MINT-1T dataset with interleaved text and images from English PDFs and research papers.

  • Image → text
  • Text generation
  • English
29.6K 9100B–1T rows
Datasetapple/DataCompDR-1BTop pick

Apple synthetic captions and embeddings for DataComp-1B

Apple's extension of the DataComp-1B dataset with synthetic captions, embeddings, and metadata for image-text pairs.

  • Text → image
  • Image → text
  • English
29.4K 371B–10B rows
DatasetSilversorrow/SpineBench

Medical VQA benchmark for spine diseases

64,878 English QA pairs for 40,263 spine images to evaluate multimodal models.

  • Visual question answering
  • Multiple choice
  • English
29.2K 010K–100K rows
Datasetpoloclub/diffusiondb

2M Stable Diffusion images with prompts

2M Stable Diffusion images with prompts and hyperparameters from real users.

  • Text → image
  • Image → text
  • English
29.2K 678over 1T rows