Skip to content

Datasets

Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.

Data type

For which models

Find a dataset for your goal

Answered by Gemini 4 · the chat is kept only in this tab

DatasetRekaAI/RekaDaily-10k-raw

Raw first-person everyday life video dataset

Unedited daily and working first-person video recordings in English for training video models.

  • Video classification
  • Image → video
  • English
187.1K 32100K–1M rows
Datasetoriginlab/game-recordings-free-camera-v2Top pick

Multi-view RGB-D gaming world dataset

106 hours of free-camera flights across 17 games for 3D reconstruction and video generation.

  • Depth estimation
  • Image → 3d
  • Image → video
  • English
49.7K 4up to 1K rows🔒 on request
DatasetMutonix/Vript

Video Clips with Script Annotations and Camera Motion

About 400k English video clips with detailed scene, shot, and camera motion descriptions.

  • Video classification
  • Visual question answering
  • Text → video
  • English
37.3K 27100K–1M rows
DatasetInternRobotics/OmniWorldTop pick

Multimodal dataset for 4D world modeling

Large multi-domain image-text corpus for 4D world modeling and robotics.

  • Text → video
  • Image → video
  • Image → 3d
  • English
35.4K 1031B–10B rows
DatasetDev-Jahn/OpenVid-1M-wds

OpenVid-1M Video Dataset in WebDataset Format

Repackaged OpenVid-1M dataset into .tar shards for fast streaming during video model training.

  • Text → video
  • Video classification
  • English
27.8K 21M–10M rows
DatasetVchitect/Vchitect_T2V_DataVerseTop pick

Video dataset for text-to-video models

A collection of 14M videos with text descriptions for training text-to-video diffusion models.

  • Text → video
23.9K 111M–10M rows
DatasetWenhaoWang/VidProMTop pick

VidProM: 1.67M prompts and 6.69M videos

Million-scale dataset of text prompts and generated videos for text-to-video research.

  • Text → video
  • Text → image
  • English
22.8K 841M–10M rows
Datasetonepiece1999/StatePlay-Dataset

Street Fighter III gameplay logs with actions

10 thousand five-second Street Fighter III videos with player action tables and text descriptions.

  • Image → video
  • English
20.8K 310K–100K rows
DatasetAPRIL-AIGC/UltraVideoTop pick

UHD-4K/8K Videos with Detailed Captions

A set of high-quality 4K/8K videos with structured captions for video generation.

  • Image → video
  • Text → video
17.9K 7910K–100K rows
DatasetSpatialVID/SpatialVIDTop pick

Large-scale video dataset with spatial annotations

1 to 10 million entries with spatial annotations for video and 3D generation tasks.

  • Text → video
  • Text → 3d
  • Image → 3d
  • English
14.2K 491M–10M rows🔒 on request
Datasetomegalabsinc/omega-multimodal

Multimodal video dataset from the Bittensor network

A massive video corpus with text descriptions and tabular metadata from the decentralized OMEGA Labs network.

  • Video text → text
  • Video classification
  • Image classification
11.3K 61
DatasetFelixYuan-YF/SpatialVID-HQ

Large video dataset with spatial annotations

A large-scale dataset featuring videos and spatial annotations for 3D and video generation tasks.

  • Text → video
  • Text → 3d
  • Image → 3d
  • English
5.6K 35100K–1M rows🔒 on request
DatasetNU-World-Model-Embodied-AI/phyground

Physics benchmark in generated video

250 prompts with initial frames and labels for 13 laws of physics to test the physical validity of video generation models.

  • Text → video
  • Image → video
  • English
3.9K 48up to 1K rows
Datasetjovianzm/Pexels-400k

400k Pexels Videos with Captions and Metadata

400,476 videos with previews, view counts, explicit flags, and captions for video-text models.

  • Image → text
  • Text → image
  • Text → video
  • English
2.4K 70100K–1M rows
DatasetHKUSTAudio/Talker-T2AV-Data

Talker-T2AV talking person audio-video dataset

A cleaned multimodal corpus for joint speech and video generation of talking persons in Chinese and English.

  • Text → video
  • Text → speech
  • Chinese
  • English
1.8K 7100K–1M rows
DatasetRapidata/text-2-video-human-preferences-moonvalley-marey

Human preference evaluations for Marey video generation

1,313 examples with 74.8 thousand human ratings for videos generated by the Marey model.

  • Video classification
  • Text → video
  • Text classification
  • English
1.2K 91K–10K rows
DatasetTencentARC/MiraData

Long videos with structured descriptions

A large Tencent dataset with long video clips and detailed text descriptions for training video generation.

  • Image → video
  • Text → image
  • Text → video
  • English
1.1K 43100K–1M rows
DatasetAPRIL-AIGC/Soul-Bench

Multimodal benchmark for avatar animation

Dataset of up to 1 thousand examples for evaluating image-to-video generation and digital human animation.

  • Image → video
730 56up to 1K rows
Datasetccmoony/PhyCoVE

Physically grounded video editing benchmark

508 tasks for altering physical object properties in video with reference clips and English/Chinese instructions.

  • Video → video
  • English
  • Chinese
615 2up to 1K rows
Datasetego2act/ego2act-bench

Ego2act benchmark for video generation

A benchmark for evaluating goal-directed manipulations in video generation using egocentric frames.

  • Image → video
  • Video classification
  • English
533 4up to 1K rows
DatasetRapidata/sora-video-generation-physics-likert-scoring

Physics Evaluation in Sora Video Generation

198 generated videos with human physical realism scores for training and evaluating models.

  • Video classification
  • Text → video
  • English
487 32up to 1K rows
DatasetRapidata/sora-video-generation-style-likert-scoring

Sora video visual style Likert scores

198 generated videos with 6,021 human Likert scale ratings for visual appeal.

  • Video classification
  • Text → video
  • English
382 34up to 1K rows