Skip to content

Dataset · allenai

Multimodal data for robot manipulation training

allenai/MolmoAct-Midtraining-Mixture

Image and text mixture for the midtraining phase of the open MolmoAct robotics model by Allen Institute for AI.

What's inside

Contains 1 to 10 million records (images and text) for training action reasoning in robotics. Based on part of the OXE base and 10,000 single-arm Franka robot trajectories performing 93 home and tabletop manipulation tasks.

What you can do with it

  • Training multimodal robotic manipulator control models
  • Training physical action planning and reasoning systems
Tasks
Robotics
Size
1M–10M rows
Downloads this month
76K
Likes
11

How to load it

from datasets import load_dataset

ds = load_dataset("allenai/MolmoAct-Midtraining-Mixture")