Skip to content

Datasets

Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.

Data type

For which models

Find a dataset for your goal

Answered by Gemini 4 · the chat is kept only in this tab

Datasetlinxy/LaTeX_OCR

Formula images and LaTeX markup

Pairs of mathematical formula images with LaTeX code for training and evaluating OCR.

  • Image → text
909 195100K–1M rows
DatasetOpenDataArena/MMFineReason-SFT-123K-Qwen3-VL-235B-Thinking

MMFineReason: complex VQA examples for SFT

123k most difficult image-text examples from MMFineReason where Qwen3-VL-4B-Thinking consistently fails.

  • Visual question answering
  • Question answering
  • Text generation
  • English
907 87100K–1M rows
DatasetTeklia/CASIA-HWDB2-line

CASIA handwritten Chinese text base

A line dataset of handwritten Chinese text collected from over a thousand authors.

  • Image → text
  • Chinese
894 2110K–100K rows
Datasetlaolao77/MMDU

Multi-image multi-turn dialogue benchmark

A set of 110 complex dialogues and over 1600 questions across image series for evaluating multimodal models.

  • Visual question answering
  • Question answering
  • English
863 44up to 1K rows
Datasetneulab/MultiUITop pick

MultiUI multimodal web interface dataset (7.3M)

7.3 million multimodal examples from 1 million websites for training web agents and VLM models.

  • Question answering
  • Visual question answering
  • English
847 531M–10M rows🔒 on request
DatasetChan-Y/pixelart-308k

Synthetic pixel art dataset

A dataset of 308K synthetic pixel art images paired with text descriptions.

  • Text → image
  • Image → text
842 10100K–1M rows
DatasetSakanaAI/JFinBench

JFinBench Japanese financial benchmark

An exam-based benchmark for evaluating LLMs in the Japanese financial domain.

  • Question answering
  • Visual question answering
  • Japanese
836 3up to 1K rows🔒 on request
Datasetvikhyatk/lnqa

LNQA image question answering

A VQA dataset based on Localized Narratives featuring image question-answer pairs.

  • Visual question answering
813 91100K–1M rows
Datasetevayinhao/MIRA-BenchTop pick

VLM spatial reasoning benchmark in mirror scenes

Over 14,000 question-answer pairs on real photos with reflections for evaluating multimodal models.

  • Visual question answering
  • English
803 410K–100K rows🔒 on request
DatasetOleehyO/latex-formulasTop pick

Images and LaTeX formulas for OCR

Large dataset of image-LaTeX pairs for mathematical formula recognition.

  • Image → text
802 1051M–10M rows
DatasetYqjMartin/FLARETop pick

Long video and audio moment retrieval benchmark

Set of 87.7k short video clips with three descriptions each for evaluating multimodal retrieval in long videos.

  • Video text → text
792 2100K–1M rows
DatasetRapidata/text-2-image-Rich-Human-FeedbackTop pick

Human quality evaluation of generated images

Over 1.5 million ratings from real people for images generated from English text prompts.

  • Text → image
  • Text classification
  • Image classification
  • English
787 3910K–100K rows
Datasethezarai/persian-license-plate-v1

Persian license plate recognition

Labeled dataset of Persian license plate images and text for OCR tasks.

  • Image → text
  • Persian
777 131K–10K rows
Datasettomg-group-umd/pixelprose

16.9M detailed image captions

Detailed synthetic descriptions of 16.9 million images for training and evaluating vision-language models.

  • Image → text
  • Text → image
  • Visual question answering
  • English
756 18010M–100M rows
Datasetgraph-based-captions/GBC10MTop pick

Graph-based captions for 10 million images

A large dataset of English graph annotations for CC12M images tailored for multimodal models.

  • Image → text
  • English
746 3610M–100M rows
Datasetmarkov-ai/computer-use

OSWorld computer agent trajectories

160 successful Gemini agent trajectories on OSWorld tasks with steps and 1.0 scores.

  • Robotics
  • Image → text
728 77up to 1K rows
DatasetFreedomIntelligence/PubMedVision-PlusTop pick

Large medical image and caption corpus

Large-scale English dataset of tens of millions of medical image-caption pairs from PubMed articles.

  • Image → text
  • English
689 210M–100M rows
DatasetOpenGVLab/VideoChat2-IT

Multimodal video and image instruction annotations

1.9M text annotations in JSON format for training models to answer questions about images and videos.

  • Visual question answering
  • Question answering
  • English
674 521M–10M rows🔒 on request
Datasethyperbots-inc/synthetic-doc-parsing

Synthetic annotated document parsing dataset

Dataset of 100 pages with fine-grained layout annotations, HTML tables, and text.

  • Image → text
  • Object detection
  • English
662 23up to 1K rows
Datasetgoogle/polaris-benchTop pick

Visual reasoning benchmark in polar coordinates

Official benchmark from Google DeepMind and Stanford for evaluating MLLM visual reasoning in polar coordinates.

  • Visual question answering
  • Multiple choice
  • English
627 710K–100K rows
Datasethyperbots-inc/synthetic-handwritten-forms

Synthetic handwritten-filled document forms

A dataset of synthetic printed forms filled in by hand for text recognition tasks.

  • Image → text
  • Document question answering
  • English
624 32up to 1K rows