Skip to content

Datasets

Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.

Data type

For which models

Find a dataset for your goal

Answered by Gemini 4 · the chat is kept only in this tab

Datasetworldbenchmark/IntuitivePhysicsTop pick

Intuitive physics benchmark for video and VLM models

A large English WorldBench benchmark for evaluating physical understanding in generative and vision models.

  • Visual question answering
  • Text → video
  • English
235.6K 12100K–1M rows
DatasetRekaAI/RekaDaily-10k-raw

Raw first-person everyday life video dataset

Unedited daily and working first-person video recordings in English for training video models.

  • Video classification
  • Image → video
  • English
187.1K 32100K–1M rows
DatasetGokuScraper/seedance-2-prompts-datasets

Seedance 2.0 prompts and videos

Over 8,100 English and Chinese prompts together with generated videos and preview frames.

  • Text → video
  • English
  • Chinese
124.5K 611K–10K rows
Datasetnkp37/OpenVid-1MTop pick

OpenVid-1M text-captioned video dataset

Large collection of video clips with English captions for training video generation models.

  • Text → video
  • Image → video
  • English
95.2K 3001M–10M rows
Datasetoriginlab/game-recordings-free-camera-v2Top pick

Multi-view RGB-D gaming world dataset

106 hours of free-camera flights across 17 games for 3D reconstruction and video generation.

  • Depth estimation
  • Image → 3d
  • Image → video
  • English
49.7K 4up to 1K rows🔒 on request
Datasetnvidia/PhysicalAI-WorldModel-Synthetic-Warehouse-Operations-ScenesTop pick

NVIDIA synthetic warehouse operations video dataset

About 123,000 fully annotated synthetic video clips covering warehouse safety scenarios.

  • Video classification
  • Video text → text
  • Text → video
  • English
48.6K 35100K–1M rows
Datasetgroundedsi/RoboCap-10kTop pick

RoboCap-10k: robotics dataset with 3D poses

10,000 hours of real human work video with head and hand pose annotations in video format for robotics.

  • Video classification
  • Depth estimation
  • Text → video
  • English
46.3K 81M–10M rows🔒 on request
DatasetXiangpengYang/VideoGrain-dataset

Video editing dataset for VideoGrain

English image and data collection from the VideoGrain paper (ICLR 2025) for multi-level video editing tasks.

  • Text → video
  • Text → image
  • English
40.3K 11K–10K rows
DatasetMutonix/Vript

Video Clips with Script Annotations and Camera Motion

About 400k English video clips with detailed scene, shot, and camera motion descriptions.

  • Video classification
  • Visual question answering
  • Text → video
  • English
37.3K 27100K–1M rows
DatasetInternRobotics/OmniWorldTop pick

Multimodal dataset for 4D world modeling

Large multi-domain image-text corpus for 4D world modeling and robotics.

  • Text → video
  • Image → video
  • Image → 3d
  • English
35.4K 1031B–10B rows
Datasethffordata/h3-fewstep-benchmark-20260920

MiniMax-H3 audio-visual video generation benchmark

4,320 audio-visual videos from 15 accelerated versions of the MiniMax-H3 model for evaluating generation quality in few steps.

  • Text → video
30.5K 1
DatasetDev-Jahn/OpenVid-1M-wds

OpenVid-1M Video Dataset in WebDataset Format

Repackaged OpenVid-1M dataset into .tar shards for fast streaming during video model training.

  • Text → video
  • Video classification
  • English
27.8K 21M–10M rows
DatasetVchitect/Vchitect_T2V_DataVerseTop pick

Video dataset for text-to-video models

A collection of 14M videos with text descriptions for training text-to-video diffusion models.

  • Text → video
23.9K 111M–10M rows
Datasetnetflix/Vera-Layered-Video-DatasetTop pick

Netflix layered video dataset for video editing

Dataset for the Vera model (Netflix and Caltech) for layered video editing with background preservation.

  • Text → video
23.1K 6110K–100K rows
DatasetWenhaoWang/VidProMTop pick

VidProM: 1.67M prompts and 6.69M videos

Million-scale dataset of text prompts and generated videos for text-to-video research.

  • Text → video
  • Text → image
  • English
22.8K 841M–10M rows
Datasetonepiece1999/StatePlay-Dataset

Street Fighter III gameplay logs with actions

10 thousand five-second Street Fighter III videos with player action tables and text descriptions.

  • Image → video
  • English
20.8K 310K–100K rows
DatasetPhysInOneP03/PhysInOneP03

PhysInOne visual physics dataset chunk

Part of the training sample with video and 3D data for training models to understand physics.

  • Text → video
  • Image → video
  • Video → video
  • English
20.3K 010K–100K rows
DatasetPhysInOneP04/PhysInOneP04

PhysInOne dataset shard for visual physics

A shard of a multimodal dataset containing video and 3D data for training models to understand physical laws in visual environments.

  • Text → video
  • Image → video
  • Video → video
  • English
20K 010K–100K rows
DatasetPhysInOneP05/PhysInOneP05

Video and 3D data shard for visual physics training

Part (shard 05/16) of the PhysInOne training dataset featuring video and 3D data for physical reasoning tasks.

  • Text → video
  • Image → video
  • Video → video
  • English
19.8K 110K–100K rows
DatasetvLAR/PhysInOneTop pick

Multimodal dataset for studying visual physics

Millions of videos and 3D assets for training models to understand physical laws and generate video.

  • Text → video
  • Image → video
  • Video → video
  • English
19.7K 261M–10M rows
DatasetPhysInOneP06/PhysInOneP06

Visual physics video and 3D data shard

Training part (6 of 16) of the PhysInOne dataset for video generation and understanding physical laws.

  • Text → video
  • Image → video
  • Video → video
  • English
19.7K 010K–100K rows
DatasetAPRIL-AIGC/UltraVideoTop pick

UHD-4K/8K Videos with Detailed Captions

A set of high-quality 4K/8K videos with structured captions for video generation.

  • Image → video
  • Text → video
17.9K 7910K–100K rows
Datasetbones-studio/seedTop pick

Annotated human motions for robots

142,220 human motion animations with text descriptions and annotations for humanoid robotics.

  • Robotics
  • Text → video
  • Video text → text
  • English
17.2K 522100K–1M rows🔒 on request