Skip to content

Datasets

Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.

Data type

For which models

Find a dataset for your goal

Answered by Gemini 4 · the chat is kept only in this tab

Datasetieasybooks-org/prophet-mosque-libraryTop pick

Prophet's Mosque Library: 48k Arabic Books

Digitized Arabic Islamic books from the Prophet's Mosque Library for OCR and language models.

  • Image → text
  • Arabic
545.7K 2710K–100K rows
Datasetnureasoning/nuReasoningTop pick

Multimodal Reasoning Dataset for Autonomous Vehicles

Synchronized camera, LiDAR, and step-by-step reasoning data for training autonomous driving systems.

  • Visual question answering
  • Text generation
  • Robotics
311.7K 2910K–100K rows🔒 on request
DatasetHuggingFaceM4/FineVisionMaxTop pick

Giant Collection of Images and Dialogues for VLMs

24.3 million interleaved image-text examples in English and Chinese for training multimodal models.

  • Image text → text
  • English
  • Chinese
291.9K 4810M–100M rows
DatasetHubLabs/HubEgo-100KTop pick

First-person real manual labor video dataset

Over 10,000 hours of real-world recordings of craftsmanship, cooking, and construction work with IMU sensor data.

  • Robotics
  • Video classification
  • Video text → text
  • English
257.2K 931B–10B rows🔒 on request
Datasetworldbenchmark/IntuitivePhysicsTop pick

Intuitive physics benchmark for video and VLM models

A large English WorldBench benchmark for evaluating physical understanding in generative and vision models.

  • Visual question answering
  • Text → video
  • English
235.6K 12100K–1M rows
Datasetieasybooks-org/waqfeya-library

Digitized Islamic library in Arabic

Over 10 thousand Arabic books in PDF, TXT, and DOCX formats, recognized via Google Document AI.

  • Image → text
  • Arabic
210.6K 2310K–100K rows
Datasetmlfoundations/MINT-1T-HTMLTop pick

HTML portion of MINT-1T for multimodal pre-training

English MINT-1T HTML corpus: part of an open 1 trillion token and 3.4 billion image multimodal dataset.

  • Image → text
  • Text generation
  • English
209.3K 133100M–1B rows
Datasetieasybooks-org/shamela-waqfeya-library

Digitized Arabic Islamic book library

Corpus of over 4.6 thousand Arabic books (over 5 million pages) with extracted text.

  • Image → text
  • Arabic
170.4K 121K–10K rows
Datasetibrahimhamamci/CT-RATE

CT scans with reports for 3D vision-language models

A set of CT scans with paired radiology reports for training and evaluating 3D VLMs.

  • Image → text
  • Text → image
  • Image classification
  • English
154.2K 41310K–100K rows🔒 on request
DatasetBenchCAD/BenchCAD

Multimodal CAD modeling dataset and benchmark

A three-configuration set featuring CadQuery 3D code, part renders, editing tasks, and CAD QA.

  • Image → text
  • Text generation
  • Question answering
126.5K 2310K–100K rows
Datasetpicbreeder-vlm/picbreeder-vlm-archive

VLM-agent image evolution archive

Generated images, genomes, and VLM agent reasoning logs from the Picbreeder study.

  • Image → text
  • English
125.1K 7100K–1M rows
Datasetmlfoundations/dcvlm_pool_largeTop pick

DataComp-VLM multilingual image-text pool

Huge raw pool of nearly 2 billion image-text pairs in six languages for curating data for VLMs.

  • Image text → text
  • Visual question answering
  • English
  • Chinese
  • German
  • +9
123.8K 31B–10B rows
DatasetInnovatorLab/Innovator-VL-Instruct-46MTop pick

Large-scale 46M-example SFT dataset for VLMs

A huge corpus of multimodal instructions (image + text) for full-parameter SFT of vision-language models.

  • Image text → text
  • English
103.7K 1810M–100M rows
DatasetForithmus/MR-RATETop pick

3D MRI scans with text reports

Brain and spine MRIs with text conclusions for multimodal medical models.

  • Image → text
  • Text → image
  • Image classification
  • English
93.3K 13810K–100K rows🔒 on request
DatasetMMMU/MMMU

MMMU multimodal benchmark for expert tasks

Benchmark for multimodal understanding and reasoning featuring questions with images across multiple disciplines.

  • Question answering
  • Visual question answering
  • Multiple choice
  • English
90.7K 34710K–100K rows
DatasetOpenMOSS-Team/OmniAction

RoboOmni omnimodal robot actions

Data for proactive robot manipulation in an omnimodal context.

  • Robotics
  • Multimodal
  • Audio → audio
  • English
89.5K 296
DatasetSII-Monument-Valley/CiQi-VQA

Visual question answering on antique Chinese porcelain

Multimodal dataset with images and English/Chinese questions for Chinese porcelain appraisal.

  • Question answering
  • Image text → text
  • English
  • Chinese
89K 610K–100K rows
DatasetVLM2Vec/MVBench

Video Understanding Benchmark for Multimodal AI

An English set of 1k–10k examples for evaluating models on video question-answering tasks.

  • Visual question answering
  • Video classification
  • English
87K 01K–10K rows
Datasetlmms-lab/EgoLife

Chinese video-text dataset

A collection of videos and texts for video-text-to-text tasks, currently undergoing cleaning.

  • Video text → text
  • Chinese
85.6K 3410K–100K rows
Datasettumor-vqa/DeepTumorVQA_2.0Top pick

Medical Visual Question Answering Benchmark

3D CT abdominal benchmark for Visual Question Answering with 438K QA pairs and clinical subtypes.

  • Visual question answering
  • Image classification
  • English
85.1K 810K–100K rows
Datasetmlfoundations/dcvlm-baseline-200bTop pick

DCVLM-Baseline multimodal corpus with 200B tokens

Cleaned mixture of 103.9 million image-text pairs in 6 languages in WebDataset format for VLM pre-training.

  • Image text → text
  • Visual question answering
  • English
  • Chinese
  • German
  • +9
78.3K 910K–100K rows
Dataset1aurent/unsplash-lite

Unsplash photo descriptions and metadata

A lightweight version of the Unsplash dataset with texts and metadata for 25,000 English photographs.

  • Text → image
  • Image → text
  • English
77.7K 1210K–100K rows