Skip to content

Datasets

Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.

Data type

For which models

Find a dataset for your goal

Answered by Gemini 4 · the chat is kept only in this tab

DatasetHubLabs/HubEgo-100KTop pick

First-person real manual labor video dataset

Over 10,000 hours of real-world recordings of craftsmanship, cooking, and construction work with IMU sensor data.

  • Robotics
  • Video classification
  • Video text → text
  • English
257.2K 931B–10B rows🔒 on request
Datasetlmms-lab/EgoLife

Chinese video-text dataset

A collection of videos and texts for video-text-to-text tasks, currently undergoing cleaning.

  • Video text → text
  • Chinese
85.6K 3410K–100K rows
Datasettumor-vqa/DeepTumorVQA_2.0Top pick

Medical Visual Question Answering Benchmark

3D CT abdominal benchmark for Visual Question Answering with 438K QA pairs and clinical subtypes.

  • Visual question answering
  • Image classification
  • English
85.1K 810K–100K rows
Datasetfpvlabs/stereo-550

First-person stereo video of hand manipulations

Calibrated stereo RGB videos of everyday hand actions for robotics and 3D vision.

  • Robotics
  • Video classification
  • Image → text
  • English
75.2K 41K–10K rows🔒 on request
Datasetfpvlabs/stera-10mTop pick

Stera-10m: egocentric multimodal dataset

200 hours of synchronized first-person recordings with RGB, LiDAR depth, audio, and text for embodied AI and robotics.

  • Robotics
  • Video classification
  • Image → text
  • English
72.2K 881M–10M rows🔒 on request
Datasetyyd7/OneStreamer-Core-SourceVideo

Source Videos for OneStreamer-1M Dataset

English and Chinese video files for Visual Question Answering tasks from the OneStreamer-Core project.

  • Visual question answering
  • English
  • Chinese
70.3K 5
Datasetmvp-lab/LLaVA-OneVision-2-DataTop pick

LLaVA-OneVision-2 Multimodal and Video Data

Large collection of video clips, captions, and spatial reasoning tasks for training multimodal models.

  • Video text → text
  • Visual question answering
  • Image text → text
  • English
61.5K 51up to 1K rows
Datasetnvidia/PhysicalAI-WorldModel-Synthetic-Warehouse-Operations-ScenesTop pick

NVIDIA synthetic warehouse operations video dataset

About 123,000 fully annotated synthetic video clips covering warehouse safety scenarios.

  • Video classification
  • Video text → text
  • Text → video
  • English
48.6K 35100K–1M rows
Datasetropedia-ai/xperience-10mTop pick

Egocentric multimodal experience data

A large corpus of human action video, audio, and 3D data for robotics and embodied AI.

  • Video classification
  • Image → text
  • Depth estimation
  • English
43.7K 2571M–10M rows🔒 on request
DatasetRekaAI/RekaDaily-10k-processedTop pick

First-person daily videos with captions and Q&A

Millions of short daily first-person videos with detailed captions and Q&A from Reka AI.

  • Video text → text
  • Visual question answering
  • Video classification
  • English
42.6K 121M–10M rows
DatasetHuggingFaceFV/finevideo

Videos with descriptions and questions

An English video corpus for training models to answer questions about videos.

  • Visual question answering
  • Video text → text
  • English
42K 41110K–100K rows🔒 on request
DatasetMutonix/Vript

Video Clips with Script Annotations and Camera Motion

About 400k English video clips with detailed scene, shot, and camera motion descriptions.

  • Video classification
  • Visual question answering
  • Text → video
  • English
37.3K 27100K–1M rows
Datasetnyu-visionx/VSI-Bench

Video visual-spatial VQA benchmark

Video question-answering dataset for testing visual-spatial understanding in multimodal models.

  • Visual question answering
  • English
28.8K 7810K–100K rows
DatasetPawChrona/PawChrona-MMQA

Pet Health and Behavior Multimodal Q&A Dataset

49K English and Chinese questions about cats and dogs with images, audio, video, and text.

  • Visual question answering
  • Question answering
  • English
  • Chinese
27.4K 11100K–1M rows🔒 on request
DatasetMC7ever/hf-training-corpus

Multimodal HF Corpus of 92K Datasets

Large-scale extraction of texts, images, audio, and video from open datasets in a unified parquet format.

  • Text generation
  • Image → text
  • Automatic speech recognition
  • English
26.8K 1100K–1M rows
Datasetayushsdev/qvhighlights-videos

Complete QVHighlights Benchmark Video Set

25,124 English MP4 video clips for text-to-moment retrieval tasks.

  • Video classification
  • Video text → text
  • English
25K 010K–100K rows
DatasetMCG-NJU/VideoChat3-LV116k

Long video analysis instructions (VideoChat3)

An English video-text instruction dataset for training models to understand long videos.

  • Video text → text
  • English
22.2K 151K–10K rows
DatasetSinerChen/SceneBench

Long video scene understanding benchmark

A collection of videos and questions in English for evaluating scene event understanding by multimodal LLMs.

  • Visual question answering
  • English
21.2K 3up to 1K rows
DatasetHumanBehaviorAtlas/human_behavior_atlasTop pick

Multimodal dataset for behavior and emotion analysis

Combined corpus of 16 datasets with video, audio, and text for recognizing emotions, humor, and human state.

  • Video classification
  • Audio classification
  • Text classification
  • English
  • Chinese
20K 4100K–1M rows
DatasetONE-Lab/GUI-World

Video benchmark for multimodal AI agents in interfaces

Dataset featuring videos and questions to evaluate multimodal models in dynamic GUI environments.

  • Question answering
  • Text generation
  • Video text → text
  • English
20K 4610K–100K rows
DatasetShareGPT4Video/ShareGPT4Video

ShareGPT4Video: video captions

4.8M multimodal GPT-4-Vision video descriptions for LVLM and text-to-video models.

  • Visual question answering
  • Question answering
  • English
14K 21610K–100K rows
DatasetMME-Benchmarks/Video-MME-v2

Video-MME v2 Video Understanding Benchmark

Updated benchmark with English videos and annotations for comprehensive evaluation of video models.

  • Video text → text
  • English
13.3K 521K–10K rows