GR00T N1.7 for robotic arm: model for block-moving task
2 min read
A new operating policy for robotics, trained on NVIDIA's GR00T N1.7 architecture. The model is built to let a robot perform precise actions based on camera feeds and manipulator state. Trained using the LeRobot library, it specializes in the basic task of picking up and moving items. Useful for researchers and engineers working with physical robotic arms.
Key features
- GR00T N1.7 foundation: built on NVIDIA's advanced architecture for humanoid robots and robotics tasks.
- Multimodal input: processes data from two cameras (head and table) along with the current robot state.
- Narrow specialization: the model is trained on the task of moving a block into a box.
- LeRobot integration: fully supported by the LeRobot ecosystem for quick launch and fine-tuning.
What you can do
- Run on a robot: apply the ready-made policy to perform the block-in-box task using a rollout script.
- Use the dataset: explore the training demonstrations and trajectories from the associated cube_task_v1 dataset.
- Fine-tune the model: use the collected episodes to adapt the robot to new scenarios and environments.
Example
Running the ready-made policy on your robot using the LeRobot command-line utility:
lerobot-rollout \
--strategy.type=base \
--robot.type=so_follower \
--robot.port= \
--robot.cameras="{ head: {type: opencv, index_or_path: 0, width: 640, height: 480, fps: 30}, table: {type: opencv, index_or_path: 1, width: 640, height: 480, fps: 30}}" \
--policy.path=ButteredWaffle/cube_task_v1_groot_n17 \
--task="Put the cube in the box" \
--duration=60Read more
DetailsLicense: apache-2.0
Robot type: so_follower (cameras: head, table)
Training data: 75 episodes, 37,058 frames at 30 FPS
Training parameters: 7,000 steps, batch size 4, adamw optimizer (lr=0.0001)










Comments