Skip to content

Datasets

Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.

Data type

For which models

Find a dataset for your goal

Answered by Gemini 4 · the chat is kept only in this tab

Datasetworldbenchmark/IntuitivePhysicsTop pick

Intuitive physics benchmark for video and VLM models

A large English WorldBench benchmark for evaluating physical understanding in generative and vision models.

  • Visual question answering
  • Text → video
  • English
235.6K 12100K–1M rows
DatasetRekaAI/RekaDaily-10k-raw

Raw first-person everyday life video dataset

Unedited daily and working first-person video recordings in English for training video models.

  • Video classification
  • Image → video
  • English
174.4K 32100K–1M rows
DatasetGokuScraper/seedance-2-prompts-datasets

Seedance 2.0 prompts and videos

Over 8,100 English and Chinese prompts together with generated videos and preview frames.

  • Text → video
  • English
  • Chinese
126.4K 611K–10K rows
DatasetXiangpengYang/VideoGrain-dataset

Video editing dataset for VideoGrain

English image and data collection from the VideoGrain paper (ICLR 2025) for multi-level video editing tasks.

  • Text → video
  • Text → image
  • English
40.3K 11K–10K rows
DatasetInternRobotics/OmniWorldTop pick

Multimodal dataset for 4D world modeling

Large multi-domain image-text corpus for 4D world modeling and robotics.

  • Text → video
  • Image → video
  • Image → 3d
  • English
35.4K 1031B–10B rows
DatasetRapidata/text-to-3d-with-llm-code

LLM 3D code generation benchmark with human ratings

44,482 examples and over 780,000 human ratings to test LLM capability in creating 3D objects via code.

  • Text → video
  • English
7.7K 5110K–100K rows
Datasetjovianzm/Pexels-400k

400k Pexels Videos with Captions and Metadata

400,476 videos with previews, view counts, explicit flags, and captions for video-text models.

  • Image → text
  • Text → image
  • Text → video
  • English
2.4K 69100K–1M rows
DatasetRapidata/text-2-video-human-preferences-moonvalley-marey

Human preference evaluations for Marey video generation

1,313 examples with 74.8 thousand human ratings for videos generated by the Marey model.

  • Video classification
  • Text → video
  • Text classification
  • English
1.2K 91K–10K rows
DatasetAPRIL-AIGC/Soul-Bench

Multimodal benchmark for avatar animation

Dataset of up to 1 thousand examples for evaluating image-to-video generation and digital human animation.

  • Image → video
730 56up to 1K rows
Datasetego2act/ego2act-bench

Ego2act benchmark for video generation

A benchmark for evaluating goal-directed manipulations in video generation using egocentric frames.

  • Image → video
  • Video classification
  • English
533 4up to 1K rows
DatasetRapidata/sora-video-generation-physics-likert-scoring

Physics Evaluation in Sora Video Generation

198 generated videos with human physical realism scores for training and evaluating models.

  • Video classification
  • Text → video
  • English
487 32up to 1K rows
Datasetyandex/mad-carsTop pick

Yandex 360-degree car reviews (MAD-Cars)

A large dataset of ~70K full HD circular car video reviews for video generation tasks.

  • Image → video
188 371M–10M rows