Skip to content

Datasets

Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.

Data type

For which models

Find a dataset for your goal

Answered by Gemini 4 · the chat is kept only in this tab

DatasetKimWooJin/26-haikuthon-train

Paired images and prompts for RAG

A dataset of 4,000 pairs of PNG images and English prompts for multimodal retrieval.

  • English
1.6K 141K–10K rows
Datasetecnu-icalk/cmm-math

Chinese multimodal math dataset

A collection of school math problems with images in Chinese for training and evaluating multimodal models.

  • Chinese
1.6K 3710K–100K rows
Datasetdiffusers/pokemon-gpt4-captions

Pokemon images with detailed GPT-4 descriptions

A small dataset of Pokemon images (under 1,000 items) re-captioned with GPT-4 Turbo for image generation.

  • Text → image
  • English
1.6K 43up to 1K rows
Datasetvidore/docvqa_test_subsampled

DocVQA test subset for document retrieval

A subset of 500 English question-answer pairs for document scans to evaluate multimodal retrieval and VQA.

  • Document question answering
  • Visual document retrieval
  • English
1.6K 7up to 1K rows
Datasetgigant/oldbookillustrations

Scans of vintage book illustrations with descriptions

A collection of 4,172 scanned engravings and drawings from old books with text captions for image generation and analysis.

  • Text → image
  • Image → text
  • Image → image
  • English
  • French
  • German
1.6K 411K–10K rows
Datasetallenai/pixmo-cap

Long and detailed image descriptions for VLMs

Hundreds of thousands of images with detailed texts averaging 200 words and original speech transcripts.

  • Image → text
1.5K 49100K–1M rows
Datasetmultimodalart/facesyntheticsspigacaptioned

Synthetic faces with landmarks and captions

Between 100K and 1M synthetic portraits from Microsoft FaceSynthetics with SPIGA facial landmark annotations and BLIP captions.

    1.5K 34100K–1M rows
    Datasetopenbmb/RLHF-V-Dataset

    Multimodal preferences for RLHF

    A small set of multimodal feedback for aligning vision-language models.

    • Text generation
    • Visual question answering
    • English
    1.5K 871K–10K rows
    Datasetxjh19972/boson-nighttime

    Drone thermal geolocation dataset

    Boson thermal camera image dataset for image-to-image and geolocation tasks.

    • Image → image
    1.5K 24up to 1K rows🔒 on request
    DatasetSAFER-Activities/SAFER-Activities

    Video with fall and daily activity annotations

    10 to 100 thousand frames from long multi-camera videos with frame-by-frame annotation of falls and actions, including wheelchair users.

    • Video classification
    • Keypoint detection
    1.5K 4210K–100K rows🔒 on request
    DatasetLayered-Labs/ACNE04

    Facial photos with acne and severity labels

    A corpus of 1,457 images with Hayashi scale acne severity assessment and nearly 19k lesion boxes.

    • Image classification
    • Object detection
    • English
    1.5K 41K–10K rows
    DatasetKBlueLeaf/danbooru2023-webp-4Mpixel

    Compressed Danbooru 2023 images

    Recompressed Danbooru 2023 version: cleaned images up to 4 MP for training generative models.

    • Image classification
    • Zero shot image classification
    • Text → image
    • English
    1.5K 83100M–1B rows🔒 on request
    DatasetLuckyjhg/Geo170K

    Geo170K multimodal geometry dataset

    Over 170k pairs of geometric images and texts for training multimodal models.

      1.5K 46100K–1M rows
      DatasetHcompany/WebClick

      Web screenshot click benchmark

      1,639 English website screenshots with instructions and pixel targets for web navigation verification.

      • Visual document retrieval
      • English
      1.5K 841K–10K rows
      DatasetHuggingFaceH4/llava-instruct-mix-vsft

      LLaVA multimodal instructions for VSFT

      Formatted corpus with images and text for visual SFT fine-tuning via TRL.

        1.4K 50100K–1M rows
        Datasetaxxkaya/UVT-Terminological-based-Vision-Tasks

        Descriptive instructions for computer vision tasks

        Large image-text pair corpus with detailed instructions for training CV models for zero-shot generalization.

        • English
        1.4K 411M–10M rows
        Datasetdinhanhx/crossmodal-3600

        Multilingual image description dataset

        Set of 3,600 global images with reference descriptions in 36 languages.

        • Image → text
        • Arabic
        • Bangla
        • Czech
        • +9
        1.4K 71K–10K rows