PANDA-HSP/groot17-panda-ee-new-bread-all-noft
robotic arm control model without a force sensor
2 min readupdated
This model is a fine-tune of the 3.14-billion-parameter nvidia/GR00T-N1.7-3B base model, built to control the Panda EE robotic arm. Its main distinction is that it was trained to operate without the Robotiq FT 300 force-torque sensor typically mounted between the manipulator flange and the gripper. During data preparation, all poses in the states and actions were offset by 37.5 millimeters along the Z-axis so the gripper fingertips still reach the exact same positions as in the original demonstrations. It is useful for researchers and engineers working with the lerobot framework and Panda robots running a sensorless setup.
Key features
- Base model: Built on NVIDIA GR00T-N1.7-3B using the
lerobotlibrary (version 0.6.2). - Geometry adaptation: Accounts for removing the 37.5 mm sensor by offsetting coordinates along the flange Z-axis.
- Rotation representation: Uses a rotation vector (rotvec) with the
ee_rotation_frame = "gripper_down"frame. - Multitask training: Trained on a combined dataset of 230 episodes (new_bread_1, 2, and 3) covering bread manipulation tasks.
What you can do
- Move bread slices: Apply the model to robotic tasks involving transferring slices of bread from a cutting board onto a plate.
- Assemble and disassemble sandwiches: Use it to grasp a second slice of bread and position it accurately on top of another.
- Deploy on hardware: Run control pipelines on a real or simulated Panda EE arm without an FT300 sensor installed.
Example
During deployment and inference, make sure to use the same rotation representation and gripper frame configuration (ee_rotation_frame = "gripper_down"), and account for the missing physical force sensor in the manipulator's hardware setup.
Read more
Details• Architecture: Based on nvidia/GR00T-N1.7-3B (3.14B parameters)
• Training: 40,000 steps, batch size 8, lr 1e-4 (cosine scheduler)
• Dataset: 230 episodes (multitask new_bread_all_noft)
• Validation: 5% held-out episodes (eval_split=0.05)










Comments