Skip to content

Datasets

Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.

Data type

For which models

Find a dataset for your goal

Answered by Gemini 4 · the chat is kept only in this tab

DatasetShareGPT4Video/ShareGPT4Video

ShareGPT4Video: video captions

4.8M multimodal GPT-4-Vision video descriptions for LVLM and text-to-video models.

  • Visual question answering
  • Question answering
  • English
14K 21610K–100K rows
DatasetSoccerNet/SoccerNet_raw_HQ

High-quality football match video recordings

An archive of 500 full broadcasts of European football matches and derived data for computer vision.

    13.3K 73🔒 on request
    DatasetDAGroup-PKU/RoVid-XTop pick

    Robotic videos for embodied generation

    4M robotic clips with RGB, depth, and optical flow for image-to-video.

    • Image → video
    • English
    13.2K 74over 1T rows
    DatasetMME-Benchmarks/Video-MME-v2

    Video-MME v2 Video Understanding Benchmark

    Updated benchmark with English videos and annotations for comprehensive evaluation of video models.

    • Video text → text
    • English
    13.1K 521K–10K rows
    DatasetTIGER-Lab/VideoFeedback

    Generated Video Quality Ratings Across 5 Criteria

    37.6 thousand text-video pairs from 11 generators with human annotations for training evaluation models.

    • Video classification
    • English
    13.1K 3510K–100K rows
    DatasetOpenEnvisionLab/WorldAtlasTop pick

    WorldAtlas benchmark for evaluating generative world models

    A large collection of labeled images and reference videos in English to check consistency and physical plausibility of scene generators.

    • Other
    • English
    13K 810K–100K rows🔒 on request
    Datasetanthonytec2/OctoSenseTop pick

    OctoSense multi-sensor driving dataset

    8.43 TB of synchronized sensor data for autonomous driving and robotics.

    • Depth estimation
    • Image segmentation
    • Robotics
    12.4K 38up to 1K rows
    Datasetmarkov-ai/computer-use-largeTop pick

    Videos of professional software usage

    48k screencasts (12.3k hours) for training and evaluating video and robotic models.

    • Video classification
    • Robotics
    • English
    11.6K 21010K–100K rows
    Datasetomegalabsinc/omega-multimodal

    Multimodal video dataset from the Bittensor network

    A massive video corpus with text descriptions and tabular metadata from the decentralized OMEGA Labs network.

    • Video text → text
    • Video classification
    • Image classification
    11.3K 61
    Datasetjunchaoh-cs/SolarWM-Data

    Video Indexes and Annotations for World Models

    Metadata, indexes, and camera-aligned video reconstruction packages for training world models.

    • English
    11.2K 561M–10M rows🔒 on request
    DatasetLewandofski/OpenVE-3MTop pick

    Video editing instruction dataset

    Large open dataset of video pairs with instructions for training video editing models.

      10.3K 981M–10M rows
      Datasetunibuc-cs/MAVOS-DDTop pick

      MAVOS-DD multilingual deepfake benchmark

      A benchmark for audio-video deepfake detection across multiple languages.

      • Video classification
      • Arabic
      • Romanian
      • English
      • +4
      9.9K 1110K–100K rows🔒 on request
      DatasetVoxel51/WLASL

      American Sign Language video dataset (WLASL)

      11,980 English video examples for gesture classification and sign language recognition.

      • Video classification
      • English
      9.7K 1510K–100K rows
      Datasetempiricearth/nexar_collision_prediction

      Dashcam videos for collision prediction

      A set of 1,500 driving videos with accident and normal situations for training collision prediction models.

      • Video classification
      • English
      7.7K 421K–10K rows🔒 on request
      Datasetnexar-ai/nexar_collision_prediction

      Dashcam videos for collision prediction

      1,500 Nexar dashcam video clips with accidents and normal driving for collision avoidance systems.

      • Video classification
      • English
      7K 401K–10K rows🔒 on request
      Datasetjamescalam/youtube-transcriptions

      Technical YouTube Tutorial Transcriptions

      Short text snippets from English video tutorials with timestamps for search and RAG.

      • Question answering
      • Text retrieval
      • Visual question answering
      • English
      6.5K 44100K–1M rows
      DatasetOriginFlow-AI/origindata-preview-sampleTop pick

      Hand-Object Interaction: Video, Poses, and Force

      A robotics multimodal dataset featuring hand motion recordings and applied force in real-world tasks.

      • Robotics
      6.4K 2510M–100M rows🔒 on request
      DatasetSKY-Piano/SKY-Piano

      Multimodal Piano Performance Dataset

      Synchronized audio, MIDI, motion capture, and fingering data for piano performance analysis.

        6.1K 10🔒 on request
        DatasetHFUT-MMH-Lab/multimodal_mental_health_dataset_MMH

        Multimodal dataset for mental disorder diagnosis

        Participant audio, video, and texts in English and Chinese with clinically confirmed diagnoses for distinguishing disorders.

        • Audio classification
        • Video classification
        • Text classification
        • English
        • Chinese
        5.3K 510K–100K rows