Skip to content

Datasets

Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.

Data type

For which models

Find a dataset for your goal

Answered by Gemini 4 · the chat is kept only in this tab

Datasetfpvlabs/stera-10mTop pick

Stera-10m: egocentric multimodal dataset

200 hours of synchronized first-person recordings with RGB, LiDAR depth, audio, and text for embodied AI and robotics.

  • Robotics
  • Video classification
  • Image → text
  • English
72.2K 881M–10M rows🔒 on request
Datasetropedia-ai/xperience-10mTop pick

Egocentric multimodal experience data

A large corpus of human action video, audio, and 3D data for robotics and embodied AI.

  • Video classification
  • Image → text
  • Depth estimation
  • English
43.7K 2571M–10M rows🔒 on request
DatasetARTPARK-IISc/VaaniTop pick

Vaani Indian multilingual speech

31k hours of image-prompted spontaneous speech across 105 Indian languages, with transcripts for ASR and multimodal tasks.

  • Automatic speech recognition
  • Text → speech
  • Image → text
  • Nepali
  • Assamese
  • Malayalam
  • +9
37K 19810M–100M rows🔒 on request
DatasetPawChrona/PawChrona-MMQA

Pet Health and Behavior Multimodal Q&A Dataset

49K English and Chinese questions about cats and dogs with images, audio, video, and text.

  • Visual question answering
  • Question answering
  • English
  • Chinese
27.4K 11100K–1M rows🔒 on request
DatasetMC7ever/hf-training-corpus

Multimodal HF Corpus of 92K Datasets

Large-scale extraction of texts, images, audio, and video from open datasets in a unified parquet format.

  • Text generation
  • Image → text
  • Automatic speech recognition
  • English
26.8K 1100K–1M rows
DatasetHumanBehaviorAtlas/human_behavior_atlasTop pick

Multimodal dataset for behavior and emotion analysis

Combined corpus of 16 datasets with video, audio, and text for recognizing emotions, humor, and human state.

  • Video classification
  • Audio classification
  • Text classification
  • English
  • Chinese
20K 4100K–1M rows
DatasetPKU-Alignment/align-anything

Multimodal model alignment dataset

Preference score data and text feedback for aligning models across text, images, audio, and tables.

  • Multimodal
7.1K 5010K–100K rows
Datasetjamescalam/youtube-transcriptions

Technical YouTube Tutorial Transcriptions

Short text snippets from English video tutorials with timestamps for search and RAG.

  • Question answering
  • Text retrieval
  • Visual question answering
  • English
6.5K 44100K–1M rows
DatasetFBK-MT/MCIFTop pick

Multilingual multimodal benchmark on scientific reports

Human-annotated instruction dataset based on scientific reports: speech, video, and text across four languages to evaluate MLLMs.

  • Automatic speech recognition
  • Question answering
  • Summarization
  • English
  • German
  • Italian
  • +1
3.2K 711K–10K rows