Skip to content

Datasets

Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.

Data type

For which models

Find a dataset for your goal

Answered by Gemini 4 · the chat is kept only in this tab

Datasetagibot-world/AgiBotWorld2026Top pick

Real-world data for AgiBot World 2026 robots

Corpus of real scenes with images and video for training and evaluating embodied AI and robotics.

  • Robotics
  • English
2.1M 115100K–1M rows
Datasetjat-project/jat-dataset

Multimodal data for a general agent

A mix of expert RL demonstrations, image-caption pairs, and text for training a multimodal agent.

  • Reinforcement learning
  • Text generation
  • Question answering
128.3K 89100M–1B rows
Datasetnvidia/USDCraft-10K

NVIDIA OpenUSD simulation 3D assets

1,000 to 10,000 movable and rigid 3D objects with physics and joints for robot training.

  • Robotics
76.2K 14910K–100K rows
Datasetallenai/MolmoAct-Midtraining-MixtureTop pick

Multimodal data for robot manipulation training

Image and text mixture for the midtraining phase of the open MolmoAct robotics model by Allen Institute for AI.

  • Robotics
76K 111M–10M rows
DatasetInternRobotics/InternData-A1Top pick

Robot manipulators: 630K trajectories

Hybrid synthetic-real trajectory dataset for training robotic manipulators.

  • Other
  • Robotics
  • English
71.9K 118over 1T rows🔒 on request
DatasetInternRobotics/SynthVerse

Synthetic dataset for point tracking

Synthetic images and texts for point tracking, 3D reconstruction, and robotics tasks.

  • Robotics
  • Image → 3d
51.7K 161K–10K rows
Datasetphysical-intelligence/libero

LIBERO Robots in LeRobot Format

Four LIBERO datasets with Panda robot episodes, merged and converted to the LeRobot format.

  • Robotics
50.4K 98100K–1M rows
DatasetIDEAS-Lab-Northwestern/ManiGuard-Bench

Home robotics safety benchmark

1,000 simulations to verify how accurately and safely robots perform household tasks.

  • Robotics
45.8K 21K–10K rows
Datasetnewniuuu/OpenFly-traj-converted

Converted OpenFly Trajectories

Converted trajectory subsets from the OpenFly dataset for robotics applications.

  • Robotics
  • English
45.3K 0100K–1M rows
Datasetgagandeepreehal/indus-ad-monocam

Monocular car camera recordings on Indian roads

96 single-camera driving videos and over 105 thousand frames with depth and semantic segmentation annotations.

  • Robotics
  • Depth estimation
  • Image segmentation
  • English
40.6K 1100K–1M rows🔒 on request
DatasetInternRobotics/OmniWorldTop pick

Multimodal dataset for 4D world modeling

Large multi-domain image-text corpus for 4D world modeling and robotics.

  • Text → video
  • Image → video
  • Image → 3d
  • English
35.4K 1031B–10B rows
Datasetnvidia/PhysicalAI-SimReady-Warehouse-01

NVIDIA OpenUSD warehouse 3D assets for simulation

A catalog of simulation-ready 3D warehouse objects and their preview images for robotics and computer vision.

  • Image segmentation
  • Robotics
  • Depth estimation
  • English
34.7K 64up to 1K rows
Datasetallenai/MolmoAct-Dataset

MolmoAct Robot Dataset in LeRobot Format

Image and timeseries records from the Allen Institute for AI for training robotics models.

  • Robotics
26.4K 321M–10M rows
DatasetDongping-Li/EMMOE-100

Robotics, RL, and VQA training dataset

An English dataset of 10K–100K examples featuring scene descriptions, trajectories, and VQA tasks for embodied AI.

  • Visual question answering
  • Reinforcement learning
  • Robotics
  • English
25.7K 110K–100K rows
Datasetaprilrobotics/april-gloveTop pick

First-Person Video and Tactile Glove Data for Robots

Over 50 hours of hand-work video from head and wrist cameras, accompanied by 3D hand poses and 122 pressure sensor readings per hand.

  • Robotics
  • English
23.6K 3up to 1K rows🔒 on request
DatasetBreakingWeb/breakingweb-results-v3Top pick

Web agent trajectories in a browser benchmark

From 100k to 1M operational steps of top LLM agents (Claude, GPT, Gemini) in browser tasks.

  • Reinforcement learning
23.3K 0100K–1M rows
DatasetMcGill-NLP/agent-reward-bench

Web agent auto-evaluation benchmark

A set of 1–10k English web agent trajectories for evaluating automated evaluator quality.

  • Robotics
  • English
22.3K 71K–10K rows
DatasetSalesforce/3d_optical_flow_droidTop pick

Salesforce robot trajectories with 3D scene flow

Processed DROID robotics dataset with optical and 3D scene flow annotations for training robot control models.

  • Robotics
21.7K 010M–100M rows