Skip to content

Datasets

Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.

Data type

For which models

Find a dataset for your goal

Answered by Gemini 4 · the chat is kept only in this tab

DatasetSakanaAI/ALE-BenchTop pick

Competitive programming benchmark from Sakana AI and AtCoder

Official set of tasks from AtCoder contests for evaluating AI systems in algorithmic programming with scoring.

  • Image text → text
  • Reinforcement learning
  • Text generation
  • English
  • Japanese
20K 13up to 1K rows
Datasetyangzekang2000/CORAL

Mouse brain neuron reconstruction benchmark

Light microscopy images and annotations for 3D and 2D neuron reconstruction.

  • Image segmentation
  • Image → text
19.9K 11K–10K rows
DatasetAjax102/TaisuTop pick

Large-scale Chinese image-text corpus

A massive collection of Chinese image-text pairs totaling approximately 7.9 TB for image-to-text tasks.

  • Image → text
  • Chinese
19.8K 3100M–1B rows
DatasetAndyson/DefectSpectrum

Industrial defect benchmark with semantic annotation

A collection of manufacturing defect images with segmentation masks and descriptions for quality control systems.

  • Image segmentation
  • Image → text
  • English
19.8K 31K–10K rows
Datasetprinceton-nlp/CharXiv

Benchmark for analyzing complex scientific charts

2,323 scientific charts from arXiv papers to test multimodal model ability to understand complex visualizations.

  • Visual question answering
  • Document question answering
  • Question answering
  • English
19.2K 571K–10K rows
DatasetChartGalaxy/ChartGalaxy

Infographic Charts for VQA

Infographic charts with text annotations for visual understanding and generation tasks.

  • Visual question answering
  • English
18.9K 891K–10K rows
Datasetgoogle/RSRCCTop pick

Google Remote Sensing Change Captioning Benchmark

A Google Research dataset with multi-temporal aerospace image pairs and questions about terrain changes.

  • Visual question answering
  • Image text → text
  • Multiple choice
  • English
16.2K 41100K–1M rows
DatasetMathLLMs/MathVision

MATH-Vision benchmark for multimodal mathematics

Visual math problems with images and text for evaluating VLMs.

  • Question answering
  • Multiple choice
  • Visual question answering
  • English
15.7K 1841K–10K rows
DatasetMAmmoTH-VL/MAmmoTH-VL-Instruct-12M

12M visual instructions for multimodal models

Image-instruction pairs for training visual assistants in English.

  • Visual question answering
  • Question answering
  • English
15.4K 6710M–100M rows
DatasetOpen-Bee/Honey-Data-15M

Bee multimodal image-text corpus

15M English image-text pairs for training and evaluating open multimodal models.

  • Image text → text
  • English
15K 12110M–100M rows
DatasetQwen/Qwen-Image-BenchTop pick

Qwen Image Generation Benchmark

An English and Chinese image-text dataset for deep evaluation of Text-to-Image models.

  • Image → text
  • English
  • Chinese
15K 531K–10K rows
DatasetShareGPT4Video/ShareGPT4Video

ShareGPT4Video: video captions

4.8M multimodal GPT-4-Vision video descriptions for LVLM and text-to-video models.

  • Visual question answering
  • Question answering
  • English
14K 21610K–100K rows
DatasetShadenA/MathNet

Multilingual math problems with images

Problems from countries and competitions with images and text for QA and solution generation.

  • Question answering
  • Text generation
  • Image → text
  • English
  • Portuguese
  • Spanish
  • +9
13.3K 10510K–100K rows
Datasetwikimedia/wit_base

Multilingual image-text pairs from Wikipedia

Image and text connections from Wikipedia across many languages for training and evaluating multimodal retrieval.

  • Image → text
  • Text retrieval
  • Afrikaans
  • Aragonese
  • Arabic
  • +9
12.5K 77100K–1M rows
Datasetnyu-visionx/CV-Bench

CV-Bench visual benchmark for multimodal LLMs

1K to 10K test examples with images and questions to evaluate vision capabilities in multimodal models.

  • Visual question answering
  • English
12.2K 491K–10K rows
Datasethuggan/wikiart

WikiArt paintings with labels

81,444 art images with artist, genre, and style labels.

  • Image classification
  • Text → image
  • Image → text
10K 25010K–100K rows
DatasetAI4Math/MathVerse

MathVerse: visual math problems

Visual math problem benchmark for multimodal LLMs.

  • Multiple choice
  • Question answering
  • Visual question answering
  • English
9.3K 731K–10K rows
Datasetyuhos16/SkinCaReTop pick

SkinCaRe multimodal dermatology dataset

7,041 dermatology cases with medical descriptions and Chain-of-Thought reasoning.

  • Image → text
  • Chinese
  • English
9.1K 16up to 1K rows🔒 on request