Dataset · allenai
Multimodal data for robot manipulation training
allenai/MolmoAct-Midtraining-Mixture
Image and text mixture for the midtraining phase of the open MolmoAct robotics model by Allen Institute for AI.
What's inside
Contains 1 to 10 million records (images and text) for training action reasoning in robotics. Based on part of the OXE base and 10,000 single-arm Franka robot trajectories performing 93 home and tabletop manipulation tasks.
What you can do with it
- Training multimodal robotic manipulator control models
- Training physical action planning and reasoning systems
- Tasks
- Robotics
- Size
- 1M–10M rows
- Downloads this month
- 76K
- Likes
- 11
How to load it
from datasets import load_dataset
ds = load_dataset("allenai/MolmoAct-Midtraining-Mixture")