Skip to content

Datasets

Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.

Data type

For which models

Find a dataset for your goal

Answered by Gemini 4 · the chat is kept only in this tab

Datasetzlab-princeton/Vero-600k

600K examples for visual reasoning RL

A curated collection of 59 English datasets for training VLMs in logic, STEM, charts, and OCR.

  • Image text → text
  • English
50.5K 47100K–1M rows
Datasetmhjiang0408/MAC_Bench

Scientific cover benchmark for multimodal LLMs

A dynamic English-language benchmark for assessing how well multimodal LLMs understand scientific journals and illustrations.

  • Image text → text
  • English
50.5K 11K–10K rows
DatasetGreenNode/GreenOCR-Dataset

Synthetic document pages for OCR

Generated pages in Vietnamese and English with block annotations for training document parsing.

  • Image → text
  • Image text → text
  • Vietnamese
  • English
49.8K 11K–10K rows🔒 on request
DatasetFINEBENCH/FineBench

FineBench for video VQA

A large-scale multimodal benchmark for evaluating action understanding in video.

  • Visual question answering
  • Video text → text
  • English
48.3K 1100K–1M rows
DatasetAmazonScience/document-haystack

Long Document Analysis Benchmark for Visual LLMs

Multimodal dataset from Amazon Science to test VLM capability to find answers in bulky documents and images.

  • Question answering
  • Visual question answering
  • Document question answering
  • English
47.6K 26
DatasetAI4Math/MathVista

MathVista: Visual-mathematical benchmark

Mathematical reasoning benchmark over images: IQTest, FunctionQA, and PaperQA; languages en, zh, fa.

  • Multiple choice
  • Question answering
  • Visual question answering
  • English
  • Chinese
  • Persian
45.9K 2371K–10K rows
Datasetvankey/RealText-V2Top pick

Multilingual benchmark for document forgery detection

Over 20K document images across six languages for forgery detection and fake text analysis.

  • Image segmentation
  • Text classification
  • Visual question answering
  • English
  • Chinese
  • Arabic
  • +3
44.6K 810K–100K rows
Datasetsarkau/ImgMT-Dataset-For-Evaluating-Text-Image-TranslationTop pick

Infographic and Diagram Text Translation Benchmark

A multilingual collection of Wikimedia vector diagrams and maps with text coordinate annotations for evaluating image translation.

  • Image text → text
  • Image text → image
  • Translation
44K 010K–100K rows
DatasetYTxFSGAMERz/ARGUS_DATASET

ARGUS geospatial benchmark

Multi-domain benchmark for geospatial intelligence and computer vision.

  • Image classification
  • Zero shot image classification
  • Visual question answering
  • English
43.6K 0
DatasetRekaAI/RekaDaily-10k-processedTop pick

First-person daily videos with captions and Q&A

Millions of short daily first-person videos with detailed captions and Q&A from Reka AI.

  • Video text → text
  • Visual question answering
  • Video classification
  • English
42.6K 121M–10M rows
Datasetdata-is-better-together/open-image-preferences-v1

Paired comparisons of generated images by prompt

English prompt dataset with image pairs for evaluating text-to-image preferences.

  • Text → image
  • Image → text
  • English
40.8K 341K–10K rows
DatasetMMMU/MMMU_Pro

MMMU-Pro multimodal benchmark

Multidisciplinary visual and textual questions for multimodal understanding evaluation.

  • Question answering
  • Visual question answering
  • Multiple choice
  • English
40.4K 1031K–10K rows
Datasettrucmtnguyen/multimodal-product-reviews-lazada

Multimodal Lazada product reviews in Vietnamese

Vietnamese e-commerce data with product photos, descriptions, user reviews, and review images.

  • Text retrieval
  • Image text → text
  • Image → image
  • Vietnamese
38.8K 010K–100K rows
Datasetpixparse/cc12m-wds

12 million image-text description pairs

Large Conceptual Captions 12M dataset in WebDataset format for pre-training multimodal models.

  • Image → text
38.2K 4510M–100M rows
Datasetma-xu/fine-t2iTop pick

Corpus for Text-to-Image Fine-Tuning

A large open collection of English image-text pairs for high-quality text-to-image fine-tuning.

  • Image → text
  • Text → image
  • English
37.9K 136100K–1M rows
DatasetRan0/JieZiTop pick

JieZi ancient Chinese character VQA benchmark

A large expert VQA dataset for analyzing the evolution, etymology, and structure of ancient Chinese characters.

  • Visual question answering
  • Question answering
  • Chinese
37.9K 3100K–1M rows
Datasetmastersubhajit/OmnigraphCanvas-Dataset

OmnigraphCanvas Multimodal Manga Dataset

Manga illustrations and English/Japanese texts for classification and VQA.

  • Image classification
  • Object detection
  • Visual question answering
  • English
  • Japanese
37.3K 010K–100K rows🔒 on request
DatasetARTPARK-IISc/VaaniTop pick

Vaani Indian multilingual speech

31k hours of image-prompted spontaneous speech across 105 Indian languages, with transcripts for ASR and multimodal tasks.

  • Automatic speech recognition
  • Text → speech
  • Image → text
  • Nepali
  • Assamese
  • Malayalam
  • +9
37K 19810M–100M rows🔒 on request
DatasetzonghanHZH/ShowUI-web-8k

Web interface screenshots for training GUI agents

A curated selection of 8,000 English website screenshots for training models to understand web interface elements.

  • Image text → text
  • English
35.5K 01K–10K rows
DatasetServiceNow/GroundCUATop pick

Interface screenshots and annotations for AI agents

A large-scale corpus of screenshots from 87 applications with structured annotations for training computer-controlling agents.

  • Image → text
  • English
34.2K 461M–10M rows