Skip to content

Datasets

Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.

Data type

For which models

Find a dataset for your goal

Answered by Gemini 4 · the chat is kept only in this tab

DatasetOpenDataArena/MMFineReason-Full-2.3M-Qwen3-VL-235B-ThinkingTop pick

2.3m reasoning examples from Qwen3-VL-235B

Raw corpus of 2.3 million multimodal tasks and reasoning chains (8.8 billion tokens) before quality filtering.

  • Visual question answering
  • Question answering
  • Text generation
  • English
4K 651M–10M rows
DatasetTIGER-Lab/VisualWebInstruct

Multimodal instructions for VLM reasoning

Approximately 900K question-answer pairs (40% image-based, 60% text-based) for boosting multimodal model reasoning logic.

  • Question answering
  • Visual question answering
  • Image text → text
  • English
3.9K 451M–10M rows
Datasetbiglam/british-library-book-images

One Million 16th-19th Century Book Illustrations

Over 1 million illustrations extracted from digitized historical books from the British Library (1510–1900).

  • Image classification
  • Image → text
  • Text → image
3.8K 651M–10M rows
DatasetScaleAI/HSSTop pick

Intuitive Visual Reasoning Benchmark

A collection of images and short videos with questions from Scale AI to evaluate models' ability to understand hidden context.

  • Visual question answering
  • Video text → text
  • English
3.8K 19up to 1K rows
Datasetbevaya/ScreenSpot

Text-based UI element grounding benchmark

Over 1,200 instructions and screenshots from iOS, Android, macOS, Windows, and the web for evaluating multimodal models.

  • Text generation
  • Image → text
  • English
3.7K 531K–10K rows
Datasetzhihengli-casia/puredocbench

Three-mode document recognition benchmark

From 1 to 10k document pages for comparing OCR and vision-language models across three tracks.

  • Image → text
  • Document question answering
3.4K 61K–10K rows
DatasetProGamerGov/synthetic-dataset-1m-dalle3-high-quality-captions

1M AI Images with High-Quality Captions

Over a million AI-generated images with detailed English captions for text-to-image and image-to-text tasks.

  • Text → image
  • Image classification
  • Image → text
  • English
3.4K 1621M–10M rows
DatasetUniParser/OmniScienceTop pick

Scientific images with text descriptions

A large multimodal dataset for understanding scientific images: images and text for image-to-text tasks.

  • Image → text
3.3K 1301M–10M rows🔒 on request
Datasetvisual-layer/imagenet-1k-vl-enrichedTop pick

Enriched ImageNet-1K with descriptions and object boxes

An augmented version of ImageNet-1K with over a million records containing text descriptions, bounding boxes, and label error notes.

  • Object detection
  • Image classification
  • Text → image
  • English
3.1K 411M–10M rows
DatasetTencentARC/Plot2Code

Chart-to-code generation benchmark for MLLMs

Chart images and English texts to evaluate how multimodal models write code.

  • Text generation
  • Text → image
  • Image → text
  • English
3.1K 36up to 1K rows
DatasetBAAI/DenseFusion-1MTop pick

1M Dataset with Detailed Image Descriptions

A large multimodal set of 1 million to 10 million image-text pairs in English.

  • Question answering
  • Visual question answering
  • English
3K 441M–10M rows
DatasetHuggingFaceM4/DoclingMatix

Multimodal document recognition dataset

From 1 to 10 million document image-text pairs in English for training VLM models.

  • Visual question answering
  • Image text → text
  • English
2.9K 581M–10M rows
Datasetopenbmb/RLAIF-V-Dataset

RLAIF-V data for trustworthy VLMs

English images and text for training and validating trustworthy multimodal models via RLAIF.

  • Image text → text
  • Visual question answering
  • Multimodal
  • English
2.6K 22710K–100K rows
DatasetOpenDataArena/MMFineReason-1.8M-Qwen3-VL-235B-ThinkingTop pick

Multimodal reasoning on 1.8M examples

1.8M multimodal examples with detailed reasoning distilled from Qwen3-VL-235B-Thinking.

  • Visual question answering
  • Question answering
  • Text generation
  • English
2.6K 1271M–10M rows
Datasetwallstoneai/civitai-top-nsfw-images-with-metadata

Top CivitAI NSFW Images with Prompts

6k+ top-voted NSFW images from CivitAI with prompt and NSFW-level metadata.

  • Image classification
  • Image → text
  • Text → image
  • English
2.6K 771K–10K rows
DatasetPRAIG/SMB

Sheet music recognition (OMR) benchmark

Printed sheet music images with region annotations for testing optical music recognition systems.

  • Image → text
  • Image segmentation
  • Text retrieval
2.5K 17up to 1K rows🔒 on request
Datasetjovianzm/Pexels-400k

400k Pexels Videos with Captions and Metadata

400,476 videos with previews, view counts, explicit flags, and captions for video-text models.

  • Image → text
  • Text → image
  • Text → video
  • English
2.4K 70100K–1M rows
Datasetfacebook/winoground

Winoground: compositional reasoning

Image and caption pairs with identical words in different orders to test vision-language models.

  • Image → text
  • Text → image
  • Image classification
  • English
2.3K 124up to 1K rows🔒 on request
Datasetwanderkid/UniMER_Dataset

Image-based mathematical formula recognition

Over a million images of complex mathematical expressions for training OCR and image-to-text systems.

  • Image → text
  • English
  • Chinese
2.3K 301M–10M rows