Skip to content

Datasets

Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.

Data type

For which models

Find a dataset for your goal

Answered by Gemini 4 · the chat is kept only in this tab

DatasetGreenNode/GreenOCR-Dataset

Synthetic document pages for OCR

Generated pages in Vietnamese and English with block annotations for training document parsing.

  • Image → text
  • Image text → text
  • Vietnamese
  • English
49.8K 11K–10K rows🔒 on request
Datasetnvidia/PhysicalAI-WorldModel-Synthetic-Warehouse-Operations-ScenesTop pick

NVIDIA synthetic warehouse operations video dataset

About 123,000 fully annotated synthetic video clips covering warehouse safety scenarios.

  • Video classification
  • Video text → text
  • Text → video
  • English
48.6K 35100K–1M rows
DatasetFINEBENCH/FineBench

FineBench for video VQA

A large-scale multimodal benchmark for evaluating action understanding in video.

  • Visual question answering
  • Video text → text
  • English
48.3K 1100K–1M rows
DatasetAmazonScience/document-haystack

Long Document Analysis Benchmark for Visual LLMs

Multimodal dataset from Amazon Science to test VLM capability to find answers in bulky documents and images.

  • Question answering
  • Visual question answering
  • Document question answering
  • English
47.6K 26
DatasetPresentBench/PresentBench

Presentation generation evaluation benchmark

English and Chinese documents and tables for testing slide generation.

  • Multimodal
  • Text generation
  • English
  • Chinese
47K 16up to 1K rows
DatasetAI4Math/MathVista

MathVista: Visual-mathematical benchmark

Mathematical reasoning benchmark over images: IQTest, FunctionQA, and PaperQA; languages en, zh, fa.

  • Multiple choice
  • Question answering
  • Visual question answering
  • English
  • Chinese
  • Persian
45.9K 2371K–10K rows
Datasetvankey/RealText-V2Top pick

Multilingual benchmark for document forgery detection

Over 20K document images across six languages for forgery detection and fake text analysis.

  • Image segmentation
  • Text classification
  • Visual question answering
  • English
  • Chinese
  • Arabic
  • +3
44.6K 810K–100K rows
Datasetsarkau/ImgMT-Dataset-For-Evaluating-Text-Image-TranslationTop pick

Infographic and Diagram Text Translation Benchmark

A multilingual collection of Wikimedia vector diagrams and maps with text coordinate annotations for evaluating image translation.

  • Image text → text
  • Image text → image
  • Translation
44K 010K–100K rows
Datasetropedia-ai/xperience-10mTop pick

Egocentric multimodal experience data

A large corpus of human action video, audio, and 3D data for robotics and embodied AI.

  • Video classification
  • Image → text
  • Depth estimation
  • English
43.7K 2571M–10M rows🔒 on request
DatasetYTxFSGAMERz/ARGUS_DATASET

ARGUS geospatial benchmark

Multi-domain benchmark for geospatial intelligence and computer vision.

  • Image classification
  • Zero shot image classification
  • Visual question answering
  • English
43.6K 0
DatasetRekaAI/RekaDaily-10k-processedTop pick

First-person daily videos with captions and Q&A

Millions of short daily first-person videos with detailed captions and Q&A from Reka AI.

  • Video text → text
  • Visual question answering
  • Video classification
  • English
42.6K 121M–10M rows
DatasetHuggingFaceFV/finevideo

Videos with descriptions and questions

An English video corpus for training models to answer questions about videos.

  • Visual question answering
  • Video text → text
  • English
42K 41110K–100K rows🔒 on request
Datasetmlfoundations/MINT-1T-PDF-CC-2024-18Top pick

Trillion-token multimodal corpus with PDF and ArXiv

A massive open dataset of interleaved English text and images for pretraining multimodal models.

  • Image → text
  • Text generation
  • English
41.6K 32100B–1T rows
Datasetdata-is-better-together/open-image-preferences-v1

Paired comparisons of generated images by prompt

English prompt dataset with image pairs for evaluating text-to-image preferences.

  • Text → image
  • Image → text
  • English
40.8K 341K–10K rows
DatasetMMMU/MMMU_Pro

MMMU-Pro multimodal benchmark

Multidisciplinary visual and textual questions for multimodal understanding evaluation.

  • Question answering
  • Visual question answering
  • Multiple choice
  • English
40.4K 1031K–10K rows
DatasetDangindev/viet-cultural-vqa

Vietnamese cultural multimodal VQA dataset

28.5 thousand images and 119 thousand question-answer pairs about Vietnamese cultural heritage in two languages.

  • Visual question answering
  • Image classification
  • Object detection
  • Vietnamese
  • English
39.1K 1310K–100K rows
Datasettrucmtnguyen/multimodal-product-reviews-lazada

Multimodal Lazada product reviews in Vietnamese

Vietnamese e-commerce data with product photos, descriptions, user reviews, and review images.

  • Text retrieval
  • Image text → text
  • Image → image
  • Vietnamese
38.8K 010K–100K rows
Datasetpixparse/cc12m-wds

12 million image-text description pairs

Large Conceptual Captions 12M dataset in WebDataset format for pre-training multimodal models.

  • Image → text
38.2K 4510M–100M rows
Datasetma-xu/fine-t2iTop pick

Corpus for Text-to-Image Fine-Tuning

A large open collection of English image-text pairs for high-quality text-to-image fine-tuning.

  • Image → text
  • Text → image
  • English
37.9K 136100K–1M rows
DatasetRan0/JieZiTop pick

JieZi ancient Chinese character VQA benchmark

A large expert VQA dataset for analyzing the evolution, etymology, and structure of ancient Chinese characters.

  • Visual question answering
  • Question answering
  • Chinese
37.9K 3100K–1M rows
DatasetMutonix/Vript

Video Clips with Script Annotations and Camera Motion

About 400k English video clips with detailed scene, shot, and camera motion descriptions.

  • Video classification
  • Visual question answering
  • Text → video
  • English
37.3K 27100K–1M rows
Datasetmastersubhajit/OmnigraphCanvas-Dataset

OmnigraphCanvas Multimodal Manga Dataset

Manga illustrations and English/Japanese texts for classification and VQA.

  • Image classification
  • Object detection
  • Visual question answering
  • English
  • Japanese
37.3K 010K–100K rows🔒 on request