Skip to content

Datasets

Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.

Data type

For which models

Find a dataset for your goal

Answered by Gemini 4 · the chat is kept only in this tab

Datasetnvidia/Nemotron-VLM-Dataset-v2Top pick

Nemotron VLM dataset v2

Nearly triple the high-quality samples of v1 for training VLM on image and video QA.

  • Visual question answering
  • Image text → text
  • Video text → text
11.6K 991M–10M rows
Datasetomegalabsinc/omega-multimodal

Multimodal video dataset from the Bittensor network

A massive video corpus with text descriptions and tabular metadata from the decentralized OMEGA Labs network.

  • Video text → text
  • Video classification
  • Image classification
11.3K 61
DatasetAI4Math/MathVerse

MathVerse: visual math problems

Visual math problem benchmark for multimodal LLMs.

  • Multiple choice
  • Question answering
  • Visual question answering
  • English
9.3K 731K–10K rows
Datasetyuhos16/SkinCaReTop pick

SkinCaRe multimodal dermatology dataset

7,041 dermatology cases with medical descriptions and Chain-of-Thought reasoning.

  • Image → text
  • Chinese
  • English
9.1K 16up to 1K rows🔒 on request
Datasetropedia-ai/Ropedia-Xperience-2Top pick

3D scenes and first-person videos for robotics

A large Physical AI dataset with 3D room scans and egocentric recordings in a unified metric system.

  • Robotics
  • Image → 3d
  • Keypoint detection
  • English
9K 6510K–100K rows
Datasetmoonshotai/PerceptionBench

Multimodal LLM visual perception benchmark

Test suite from Moonshot AI for evaluating basic visual perception in multimodal models.

  • Visual question answering
  • English
8.8K 541K–10K rows
DatasetHaoChen2/Gastric-X

Medical CT and Report Dataset

Multi-phase abdominal CT scans with lab panels, reports, organ masks, and tumor masks.

  • Image classification
  • Image segmentation
  • Image → text
  • English
  • Chinese
8.7K 29up to 1K rows🔒 on request
Datasetzzliang/GRIT

GRIT: region-grounded image-text pairs

Large-scale corpus of image-text pairs where caption phrases are grounded to corresponding image regions.

  • Text → image
  • Image → text
  • Object detection
  • English
8.4K 17010M–100M rows
Datasetallenai/CoSyn-400K

Synthetic image-QA pairs

A collection of generated images and question-answer pairs based on executable code from AllenAI.

  • Visual question answering
8.1K 54100K–1M rows
Datasetnvidia/Nemotron-Image-Training-v3

Multimodal data for vision-language models

A large collection of image-centric data for training and evaluating vision-language models; subsets in JSONL with descriptions.

  • Visual question answering
  • Image text → text
7.4K 871M–10M rows
Datasetjmhessel/newyorker_caption_contest

New Yorker humor understanding benchmark

Cartoons and captions from the New Yorker contest for evaluating humor understanding in models.

  • Image → text
  • Multiple choice
  • Text classification
  • English
7.2K 78100K–1M rows
Datasetdatalab-to/omni_parse_bench

Document and table parsing benchmark

A set of 16,288 tests across 2,937 pages for evaluating the accuracy of text, table, and layout recognition.

  • Image → text
7.1K 22100K–1M rows
DatasetPKU-Alignment/align-anything

Multimodal model alignment dataset

Preference score data and text feedback for aligning models across text, images, audio, and tables.

  • Multimodal
7.1K 5010K–100K rows
Datasetmlfoundations/MINT-1T-ArXivTop pick

MINT-1T ArXiv scientific paper multimodal corpus

English interlaced text and image dataset from ArXiv scientific papers for pre-training.

  • Image → text
  • Text generation
  • English
7K 611M–10M rows
Datasetyatin-superintelligence/Edge-Agent-Reasoning-WebSearch-260K

Synthetic reasoning and web search dataset for small models

A 700+ million token corpus for training compact models in step-by-step task analysis and web search.

  • Text generation
  • Question answering
  • Multimodal
  • English
6.7K 55100K–1M rows
Datasetnyu-visionx/Cambrian-Alignment

Multimodal model alignment dataset collection

100K to 1M English image-text question-answer pairs for VLM alignment training.

  • Visual question answering
  • Question answering
  • English
6.6K 39100K–1M rows
Datasetjamescalam/youtube-transcriptions

Technical YouTube Tutorial Transcriptions

Short text snippets from English video tutorials with timestamps for search and RAG.

  • Question answering
  • Text retrieval
  • Visual question answering
  • English
6.5K 44100K–1M rows
Datasetkakaobrain/coyo-700m

747M Image-Text Pairs

A large corpus of alt-text and image pairs from HTML for training multimodal models.

  • Text → image
  • Image → text
  • Zero shot classification
  • English
6.5K 177100M–1B rows
DatasetDelores-Lin/MDPBenchTop pick

Multilingual document parsing benchmark

The first benchmark for evaluating recognition and parsing of real digital and photographed documents across 6 languages.

  • Image → text
  • Chinese
  • English
  • Arabic
  • +9
6.3K 60
Datasetflaviagiammarino/vqa-rad

Radiology image question answering dataset

Question-answer pairs for MedPix medical images for VQA training and testing.

  • Visual question answering
  • English
5.9K 1051K–10K rows
DatasetUkrainianCatholicUniversity/rukopysTop pick

Annotated handwritten Ukrainian texts

The first major open dataset for Ukrainian handwritten text recognition spanning over a century.

  • Object detection
  • Image → text
  • Ukrainian
5.8K 2810K–100K rows