Skip to content

Datasets

Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.

Data type

For which models

Find a dataset for your goal

Answered by Gemini 4 · the chat is kept only in this tab

Datasetnvidia/PhysicalAI-Human-1M-100KTop pick

Egocentric video and hand poses for physical AI

An open portion of NVIDIA's Human-1M collection: first-person videos, head and hand poses with text descriptions.

  • English
20.5K 127up to 1K rows
Datasetmarkov-ai/cad-environmentsTop pick

Multimodal human CAD workflow records

99 hours of complete engineer workflows in desktop CAD software with video, text, source files, and evaluation criteria.

    20.4K 17up to 1K rows
    Datasetairoa-org/yubi-corl2026-umi-arena-04-3k9

    YUBI robotics stereo video (part 4 of 5)

    The fourth part of a large-scale demonstration video dataset for the UMI Arena competition at CoRL 2026.

    • English
    20.4K 010K–100K rows🔒 on request
    DatasetPhysInOneP03/PhysInOneP03

    PhysInOne visual physics dataset chunk

    Part of the training sample with video and 3D data for training models to understand physics.

    • Text → video
    • Image → video
    • Video → video
    • English
    20.3K 010K–100K rows
    DatasetFVL-Lab/OpenViTacTop pick

    Visuo-tactile benchmark for robotics

    A dataset of 6,330 episodes for training and evaluating vision- and touch-based robotic arm models.

      20.2K 01K–10K rows
      Datasetlerobot/svla_so100_pickplace

      Pick-and-place demonstrations for SO-100 robot

      50 episodes of SO-100 manipulator operation with video and telemetry in LeRobot format for robotics training.

      • Robotics
      20.1K 1410K–100K rows
      DatasetHumanBehaviorAtlas/human_behavior_atlasTop pick

      Multimodal dataset for behavior and emotion analysis

      Combined corpus of 16 datasets with video, audio, and text for recognizing emotions, humor, and human state.

      • Video classification
      • Audio classification
      • Text classification
      • English
      • Chinese
      20K 4100K–1M rows
      DatasetONE-Lab/GUI-World

      Video benchmark for multimodal AI agents in interfaces

      Dataset featuring videos and questions to evaluate multimodal models in dynamic GUI environments.

      • Question answering
      • Text generation
      • Video text → text
      • English
      20K 4610K–100K rows
      Datasetosazuwa/wham3d-cts-trace-rollouts-20260923

      WHAM 3D simulation scenario video rollouts

      Cached video rollouts of scene continuations for diagnosing and analyzing the behavior of the WHAM 3D model.

        20K 01K–10K rows
        DatasetPhysInOneP04/PhysInOneP04

        PhysInOne dataset shard for visual physics

        A shard of a multimodal dataset containing video and 3D data for training models to understand physical laws in visual environments.

        • Text → video
        • Image → video
        • Video → video
        • English
        20K 010K–100K rows
        DatasetPhysInOneP05/PhysInOneP05

        Video and 3D data shard for visual physics training

        Part (shard 05/16) of the PhysInOne training dataset featuring video and 3D data for physical reasoning tasks.

        • Text → video
        • Image → video
        • Video → video
        • English
        19.8K 110K–100K rows
        Datasetawsaf49/epic_kitchens_100

        EPIC-KITCHENS kitchen action video dataset mirror

        A re-upload of the well-known first-person video benchmark with audio for quick downloading.

        • Voice activity detection
        • Video classification
        19.8K 28up to 1K rows
        DatasetvLAR/PhysInOneTop pick

        Multimodal dataset for studying visual physics

        Millions of videos and 3D assets for training models to understand physical laws and generate video.

        • Text → video
        • Image → video
        • Video → video
        • English
        19.7K 261M–10M rows
        DatasetPhysInOneP06/PhysInOneP06

        Visual physics video and 3D data shard

        Training part (6 of 16) of the PhysInOne dataset for video generation and understanding physical laws.

        • Text → video
        • Image → video
        • Video → video
        • English
        19.7K 010K–100K rows
        DatasetAPRIL-AIGC/UltraVideoTop pick

        UHD-4K/8K Videos with Detailed Captions

        A set of high-quality 4K/8K videos with structured captions for video generation.

        • Image → video
        • Text → video
        17.9K 7910K–100K rows
        DatasetHABSteam/multimodal-eeg-emotionTop pick

        EEG, physiology, and eye tracking during video viewing

        Synchronized recordings of brain activity, physiological indicators, and gaze of 355 individuals while watching emotional videos.

        • English
        15.1K 4010K–100K rows🔒 on request
        Datasetmarkov-ai/gaming-500-hoursTop pick

        500 hours of gameplay across 168 games

        494.7 hours of clean PC and console gameplay recordings across 168 games, split into 776 sessions.

          14.3K 269up to 1K rows