Skip to content

Datasets

Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.

Data type

For which models

Find a dataset for your goal

Answered by Gemini 4 · the chat is kept only in this tab

Datasetibm-granite/ChartNet

Multimodal Chart Dataset

A large-scale multimodal chart corpus with images and text for data extraction, VQA, and multilingual understanding.

  • Image → text
  • Visual question answering
  • Table question answering
  • English
  • Arabic
  • Chinese
  • +9
53.6K 6810M–100M rows
Datasetmvp-lab/LLaVA-OneVision-1.5-Instruct-DataTop pick

LLaVA-OneVision-1.5 multimodal instructions

22M image-text-to-text instructions for training and fine-tuning large multimodal models.

  • Image text → text
  • English
53.5K 9110M–100M rows
Datasetlhpku20010120/Omni-Edu

Multimodal School Education Instructions

Nearly 70,000 English and Chinese examples for training educational LLMs and VLMs.

  • Text generation
  • Question answering
  • Image text → text
  • English
  • Chinese
52.6K 610K–100K rows
Datasetzlab-princeton/Vero-600k

600K examples for visual reasoning RL

A curated collection of 59 English datasets for training VLMs in logic, STEM, charts, and OCR.

  • Image text → text
  • English
50.5K 47100K–1M rows
Datasetmhjiang0408/MAC_Bench

Scientific cover benchmark for multimodal LLMs

A dynamic English-language benchmark for assessing how well multimodal LLMs understand scientific journals and illustrations.

  • Image text → text
  • English
50.5K 11K–10K rows
DatasetGreenNode/GreenOCR-Dataset

Synthetic document pages for OCR

Generated pages in Vietnamese and English with block annotations for training document parsing.

  • Image → text
  • Image text → text
  • Vietnamese
  • English
49.8K 11K–10K rows🔒 on request
DatasetFINEBENCH/FineBench

FineBench for video VQA

A large-scale multimodal benchmark for evaluating action understanding in video.

  • Visual question answering
  • Video text → text
  • English
48.3K 1100K–1M rows
DatasetAmazonScience/document-haystack

Long Document Analysis Benchmark for Visual LLMs

Multimodal dataset from Amazon Science to test VLM capability to find answers in bulky documents and images.

  • Question answering
  • Visual question answering
  • Document question answering
  • English
47.6K 26
DatasetPresentBench/PresentBench

Presentation generation evaluation benchmark

English and Chinese documents and tables for testing slide generation.

  • Multimodal
  • Text generation
  • English
  • Chinese
47K 16up to 1K rows
DatasetAI4Math/MathVista

MathVista: Visual-mathematical benchmark

Mathematical reasoning benchmark over images: IQTest, FunctionQA, and PaperQA; languages en, zh, fa.

  • Multiple choice
  • Question answering
  • Visual question answering
  • English
  • Chinese
  • Persian
45.9K 2371K–10K rows
Datasetsarkau/ImgMT-Dataset-For-Evaluating-Text-Image-TranslationTop pick

Infographic and Diagram Text Translation Benchmark

A multilingual collection of Wikimedia vector diagrams and maps with text coordinate annotations for evaluating image translation.

  • Image text → text
  • Image text → image
  • Translation
44K 010K–100K rows
DatasetRekaAI/RekaDaily-10k-processedTop pick

First-person daily videos with captions and Q&A

Millions of short daily first-person videos with detailed captions and Q&A from Reka AI.

  • Video text → text
  • Visual question answering
  • Video classification
  • English
42.6K 121M–10M rows
DatasetHuggingFaceFV/finevideo

Videos with descriptions and questions

An English video corpus for training models to answer questions about videos.

  • Visual question answering
  • Video text → text
  • English
42K 41110K–100K rows🔒 on request
Datasetdata-is-better-together/open-image-preferences-v1

Paired comparisons of generated images by prompt

English prompt dataset with image pairs for evaluating text-to-image preferences.

  • Text → image
  • Image → text
  • English
40.8K 341K–10K rows
DatasetMMMU/MMMU_Pro

MMMU-Pro multimodal benchmark

Multidisciplinary visual and textual questions for multimodal understanding evaluation.

  • Question answering
  • Visual question answering
  • Multiple choice
  • English
40.4K 1031K–10K rows
Datasetpixparse/cc12m-wds

12 million image-text description pairs

Large Conceptual Captions 12M dataset in WebDataset format for pre-training multimodal models.

  • Image → text
38.2K 4510M–100M rows
Datasetma-xu/fine-t2iTop pick

Corpus for Text-to-Image Fine-Tuning

A large open collection of English image-text pairs for high-quality text-to-image fine-tuning.

  • Image → text
  • Text → image
  • English
37.9K 136100K–1M rows
DatasetMutonix/Vript

Video Clips with Script Annotations and Camera Motion

About 400k English video clips with detailed scene, shot, and camera motion descriptions.

  • Video classification
  • Visual question answering
  • Text → video
  • English
37.3K 27100K–1M rows
Datasetmastersubhajit/OmnigraphCanvas-Dataset

OmnigraphCanvas Multimodal Manga Dataset

Manga illustrations and English/Japanese texts for classification and VQA.

  • Image classification
  • Object detection
  • Visual question answering
  • English
  • Japanese
37.3K 010K–100K rows🔒 on request
DatasetARTPARK-IISc/VaaniTop pick

Vaani Indian multilingual speech

31k hours of image-prompted spontaneous speech across 105 Indian languages, with transcripts for ASR and multimodal tasks.

  • Automatic speech recognition
  • Text → speech
  • Image → text
  • Nepali
  • Assamese
  • Malayalam
  • +9
37K 19810M–100M rows🔒 on request