Skip to content

Datasets

Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.

Data type

For which models

Find a dataset for your goal

Answered by Gemini 4 · the chat is kept only in this tab

Datasetnvidia/PhysicalAI-Traffic-Anomaly-ReasoningTop pick

NVIDIA traffic anomaly video and QA dataset

Dataset with videos and text questions from NVIDIA for road anomaly analysis, accepted at NeurIPS 2026.

  • Video text → text
  • Visual question answering
  • English
1.8K 2310K–100K rows
Datasetvisheratin/laion-coco-nllb

LAION-COCO image captions in 200 languages

A multilingual corpus of image captions translated from English into 200 languages by the NLLB-200 model.

  • Image → text
  • Translation
  • Acehnese
  • acm
  • acq
  • +9
1.7K 46100K–1M rows
Datasetproject-oceania/planktonzilla-17MTop pick

17 million labeled plankton images

Largest combined dataset of plankton photographs with taxonomic labeling.

  • Image → text
  • Image classification
  • Image text → text
  • English
1.7K 810M–100M rows
DatasetHelenPeng/ExeWorldBenchTop pick

Executable 3D world code generation benchmark

An English multimodal benchmark for evaluating whether models can write working 3D scene code.

  • Text generation
  • Image text → text
  • English
1.7K 411K–10K rows
Datasetvidore/docvqa_test_subsampled

DocVQA test subset for document retrieval

A subset of 500 English question-answer pairs for document scans to evaluate multimodal retrieval and VQA.

  • Document question answering
  • Visual document retrieval
  • English
1.6K 7up to 1K rows
Datasetgigant/oldbookillustrations

Scans of vintage book illustrations with descriptions

A collection of 4,172 scanned engravings and drawings from old books with text captions for image generation and analysis.

  • Text → image
  • Image → text
  • Image → image
  • English
  • French
  • German
1.6K 411K–10K rows
Datasetallenai/pixmo-cap

Long and detailed image descriptions for VLMs

Hundreds of thousands of images with detailed texts averaging 200 words and original speech transcripts.

  • Image → text
1.5K 49100K–1M rows
Datasetopenbmb/RLHF-V-Dataset

Multimodal preferences for RLHF

A small set of multimodal feedback for aligning vision-language models.

  • Text generation
  • Visual question answering
  • English
1.5K 871K–10K rows
DatasetCATMuS/modern

CATMuS Modern handwritten text corpus

An image and text dataset for Handwritten Text Recognition (HTR) tasks in multiple European languages.

  • Image → text
  • French
  • German
  • English
  • +4
1.4K 5100K–1M rows
Datasetlightonai/LightOnOCR-mix-0126

Large full-page OCR dataset

10m-100m OCR examples: full page transcriptions in Markdown with LaTeX and HTML tables for end-to-end OCR training.

  • Image → text
  • English
  • French
  • German
  • +9
1.4K 11510M–100M rows
DatasetBUAADreamer/llava-en-zh-300k

English-Chinese bilingual multimodal instructions

300k image-question examples for training vision-language models in LLaMA Factory.

  • Text generation
  • Visual question answering
  • English
  • Chinese
1.3K 36100K–1M rows
Datasetraidium/RadImageNet-VQATop pick

CT/MRI dataset for radiological VQA

750K CT/MRI images and 7.5M generated VQA examples with expert annotations for training and benchmarking.

  • Visual question answering
  • English
1.3K 971M–10M rows🔒 on request
Datasetantins-labs/VisSearch-Bench-v1

VisSearch-Bench Visual Search Benchmark

204 English questions with 190 images for evaluating long visual search in multimodal agents.

  • Image text → text
  • English
1.2K 7up to 1K rows
Datasetfacebook/action100m-previewTop pick

Action100M: action video dataset

Large English video dataset with temporal action segments and text descriptions.

  • Video classification
  • Video text → text
  • English
1.2K 152100K–1M rows
DatasetLouisChen15/ConstructionSite

Annotated construction sites

10,013 construction site images with annotations for evaluating scene understanding in vision-language models.

  • Image → text
  • Image feature extraction
  • English
1.2K 8410K–100K rows🔒 on request
DatasetAudioVisual-Caption/ASID-1M

Audio-visual video instructions

ASID-1M: a large English instruction dataset for video understanding with controlled descriptions.

  • Image text → text
  • English
1.1K 85100K–1M rows
Datasetterryoo/TableVQA-Bench

Table and image visual question answering benchmark

English dataset for evaluating models in Visual Question Answering and table comprehension tasks.

  • Table question answering
  • Visual question answering
  • English
1.1K 351K–10K rows
DatasetDeepGlint-AI/DanQing100MTop pick

100M Chinese image-text pairs

A massive 12 TB web corpus from 2024–2025 for pre-training multimodal models.

  • Zero shot image classification
  • Image → text
  • Chinese
1K 5210M–100M rows
DatasetVLR-CVC/DocVQA-2026Top pick

DocVQA 2026 document benchmark

A small document QA benchmark across eight domains for multimodal reasoning.

  • Visual question answering
  • Document question answering
  • Image text → text
  • English
976 74up to 1K rows
Datasetskylenage-ai/DeepVision-103K

Multimodal math problems with images

100k to 1M visually diverse English math problems for training VLM reasoning.

  • Image text → text
  • English
967 37100K–1M rows
DatasetRapidata/OpenAI-4o_t2i_human_preference

Human evaluations for OpenAI 4o image generations

13k images from OpenAI 4o with over 200k real human ratings for training preference models.

  • Text → image
  • Image → text
  • Image classification
  • English
965 3510K–100K rows
Datasetbiglam/britannica-illustrated-pages

Illustrated pages of the Britannica encyclopedia

Over 115k illustrated pages from historical editions of the Britannica encyclopedia (1768–1929).

  • Image → text
  • Image classification
  • English
958 511M–10M rows
DatasetHumanbased-AI/MM-Food-100K

100k food images with metadata

Dish images with metadata for food recognition, classification, and nutritional analysis.

  • Image classification
  • Image → text
  • English
933 84100K–1M rows