Skip to content

Datasets

Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.

Data type

For which models

Find a dataset for your goal

Answered by Gemini 4 · the chat is kept only in this tab

Datasetnyu-visionx/VSI-Bench

Video visual-spatial VQA benchmark

Video question-answering dataset for testing visual-spatial understanding in multimodal models.

  • Visual question answering
  • English
28.8K 7810K–100K rows
Datasetnvidia/PhysicalAI-WorldModel-Synthetic-Digital-Human-ScenesTop pick

Large NVIDIA synthetic digital human video dataset

Nearly 6 thousand hours of Full HD digital human video in 3D scenes for physical AI training.

  • English
28.6K 57
DatasetFanqi-Lin/GoPro-Raw-Videos

Raw GoPro videos of robot manipulation

10k to 100k raw GoPro video recordings for training robots on four household tasks.

  • Robotics
27.4K 310K–100K rows
DatasetDev-Jahn/OpenVid-1M-wds

OpenVid-1M Video Dataset in WebDataset Format

Repackaged OpenVid-1M dataset into .tar shards for fast streaming during video model training.

  • Text → video
  • Video classification
  • English
27.4K 21M–10M rows
Datasetmadokalif/minecraft-vla-collect

Minecraft Agent Gameplay Logs and Videos

An archive of episodes, logs, and video recordings of AI agent actions in Minecraft for training multimodal control models.

  • Robotics
27.4K 0up to 1K rows
DatasetPawChrona/PawChrona-MMQA

Pet Health and Behavior Multimodal Q&A Dataset

49K English and Chinese questions about cats and dogs with images, audio, video, and text.

  • Visual question answering
  • Question answering
  • English
  • Chinese
27.4K 11100K–1M rows🔒 on request
DatasetCASTLE-Dataset/CASTLE2024

Multimodal Daily Activity Recordings

Synchronized video, audio, photo, and sensor data for human action recognition.

  • English
  • German
  • Vietnamese
  • +1
27.3K 9over 1T rows
DatasetMLVU/MVLU

Long video understanding benchmark (MLVU)

English-language test set and annotations for evaluating neural networks on long video analysis.

  • Question answering
  • English
26.9K 48🔒 on request
DatasetMC7ever/hf-training-corpus

Multimodal HF Corpus of 92K Datasets

Large-scale extraction of texts, images, audio, and video from open datasets in a unified parquet format.

  • Text generation
  • Image → text
  • Automatic speech recognition
  • English
26.5K 1100K–1M rows
DatasetLightwheelAI/EgoDemo

Egocentric video: 50-hour sample

A 50-hour egocentric video sample for video model classification and evaluation.

  • Video classification
  • English
26K 3891K–10K rows🔒 on request
DatasetLinzhan/Mixamo-Animations-Characters

Mixamo 3D character and animation library in FBX

A complete snapshot of the Mixamo library: 2,317 animations and 114 rigged 3D characters with a unified skeleton for motion generation.

  • Text → 3d
  • English
25.7K 151K–10K rows
Datasetayushsdev/qvhighlights-videos

Complete QVHighlights Benchmark Video Set

25,124 English MP4 video clips for text-to-moment retrieval tasks.

  • Video classification
  • Video text → text
  • English
25.4K 010K–100K rows
Datasettypoverflow/abc_130k_train

LeRobot robotics dataset

A robotics dataset containing video, tabular, and time-series data created via LeRobot.

  • Robotics
25.3K 0100M–1B rows
Datasetlerobot/high_quality_folding

Robotics dataset: folding

A robotics dataset containing video and tabular time-series data of the folding process.

  • Robotics
25.1K 81M–10M rows
DatasetOpenDriveLab/FreeTacManTop pick

Visual-tactile manipulation dataset for robotics

Over 3M visual-tactile image pairs and 10k trajectories across 50 tasks for training contact-rich robotic manipulation.

  • Robotics
24.6K 6
Datasetlerobot/aloha_sim_transfer_cube_human

ALOHA Robot Cube Transfer Simulation

Teleoperation recordings of the ALOHA robotic manipulator in simulation for robotics learning.

  • Robotics
24.4K 1810K–100K rows