Skip to content

Datasets

Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.

Data type

For which models

Find a dataset for your goal

Answered by Gemini 4 · the chat is kept only in this tab

DatasetLeoFan01/RoboBench

RoboBench Benchmark for MLLM Robotics Evaluation

English multimodal test suite for checking how well vision-language models reason in robotics scenarios.

  • Robotics
  • Visual question answering
  • English
20.4K 7up to 1K rows
DatasetIPEC-COMMUNITY/EO-Data1.5MTop pick

Multimodal dataset for robotics and embodied AI

Large-scale set of 1 to 10 million examples alternating images, text, and actions for training embodied AI.

  • Robotics
  • Visual question answering
  • Video text → text
  • English
20.3K 241M–10M rows
DatasetSakanaAI/ALE-BenchTop pick

Competitive programming benchmark from Sakana AI and AtCoder

Official set of tasks from AtCoder contests for evaluating AI systems in algorithmic programming with scoring.

  • Image text → text
  • Reinforcement learning
  • Text generation
  • English
  • Japanese
20K 13up to 1K rows
Datasetallenai/MolmoAct-Pretraining-MixtureTop pick

Data mixture for robotics model pre-training

A multimodal corpus of trajectories and action reasoning for training robotic manipulator control models.

  • Robotics
19.8K 1410M–100M rows
DatasetHuggingFaceVLA/libero

Panda robot data for LIBERO tasks

Panda robot manipulation episodes: 1,693 episodes, 273k frames, and 40 tasks for training robotics policies.

  • Robotics
14K 72100K–1M rows
Datasetanthonytec2/OctoSenseTop pick

OctoSense multi-sensor driving dataset

8.43 TB of synchronized sensor data for autonomous driving and robotics.

  • Depth estimation
  • Image segmentation
  • Robotics
12.4K 38up to 1K rows
Datasetropedia-ai/Ropedia-Xperience-2Top pick

3D scenes and first-person videos for robotics

A large Physical AI dataset with 3D room scans and egocentric recordings in a unified metric system.

  • Robotics
  • Image → 3d
  • Keypoint detection
  • English
9K 6510K–100K rows
Datasetyatin-superintelligence/Edge-Agent-Reasoning-WebSearch-260K

Synthetic reasoning and web search dataset for small models

A 700+ million token corpus for training compact models in step-by-step task analysis and web search.

  • Text generation
  • Question answering
  • Multimodal
  • English
6.7K 55100K–1M rows
DatasetRapidata/text-to-svg-human-feedback-benchmarkTop pick

Human pairwise evaluations for SVG graphics generation

Over half a million vector graphic comparisons of 75 models across text prompts with 3.4 million human votes.

  • Text → image
  • Image classification
  • Reinforcement learning
  • English
5.4K 39100K–1M rows
DatasetYootta/World-SimReady-Home

SimReady home scene assets for robots

CAD assets and scenes with configured physics for home robot simulation.

  • Robotics
  • English
3.2K 112🔒 on request
Datasetspatialverse/SAGE-3D_InteriorGS_usdz

3D interior Gaussian scenes in USDZ for Isaac Sim

1,000 interior 3D scenes in USDZ format for simulation and robotics in NVIDIA Isaac Sim.

  • Robotics
  • Image → 3d
  • English
2.6K 90up to 1K rows
Datasetspatialverse/SAGE-3D_Collision_Mesh

Collision meshes for 1,000 indoor scenes

High-precision collision meshes for 1,000 indoor scenes for physically accurate navigation and interaction.

  • Robotics
  • Image → 3d
1.8K 105up to 1K rows
DatasetInternRobotics/MotionMillionTop pick

2000+ Hours of Annotated Human Motion Capture

A large-scale human motion dataset extracted from web video with detailed descriptions for robotics and animation generation.

  • Other
  • Robotics
  • English
1.2K 581M–10M rows🔒 on request
DatasetRapidata/OpenAI-4o_t2i_human_preference

Human evaluations for OpenAI 4o image generations

13k images from OpenAI 4o with over 200k real human ratings for training preference models.

  • Text → image
  • Image → text
  • Image classification
  • English
965 3510K–100K rows
Datasetmarkov-ai/computer-use

OSWorld computer agent trajectories

160 successful Gemini agent trajectories on OSWorld tasks with steps and 1.0 scores.

  • Robotics
  • Image → text
728 77up to 1K rows
Datasetsamliumay/FPV-Kamikaze-Drone-Action-Dataset

In-game FPV drone control dataset

FPV drone simulator gameplay recordings with timestamped controller states.

  • Robotics
719 21K–10K rows
DatasetRapidata/bananamark-dataset

Comparison of 11 image generators on banana prompts

A dataset of human pairwise evaluations (2,161 rows) for banana images from 11 generative models.

  • Text → image
  • Image → text
  • Image classification
  • English
216 351K–10K rows