chunbae27/dp_pick_cube
diffusion policy for robot arms
2 min readupdated
This checkpoint implements Diffusion Policy (a robot control method using diffusion processes that turns visual data and state into smooth actions). The model was trained using the LeRobot library (a machine learning tool for real-world robotics) for the task of moving a cube to the right. It analyzes frames from two cameras (overhead and wrist-mounted) and the current robot state. The profile suits researchers and engineers working with so_follower type robots.
Key features
- Diffusion Policy base: processing visuomotor control (vision and movement-based control) as a generation process for smooth multi-step trajectories.
- Two cameras: using streams from the top-down and robot wrist views.
- LeRobot integration: full compatibility with the Hugging Face robotics ecosystem.
- Training dataset: trained on 50 episodes (chunbae27/pick-cube) totaling 18,472 frames.
What you can do
- Run on a robot: apply the policy on a physical so_follower manipulator to automatically pick up and move a cube to the right.
- Fine-tune the model: use the dataset repository for experiments with simulations or real hardware via train scripts.
Example
Running the ready inference policy (the process of applying a trained model) on a robot using the LeRobot command-line utility:
lerobot-rollout \
--strategy.type=base \
--robot.type=so_follower \
--robot.port= \
--robot.cameras="{ : {type: opencv, index_or_path: , width: 640, height: 480, fps: 30}, : {type: opencv, index_or_path: , width: 640, height: 480, fps: 30}}" \
--policy.path=chunbae27/dp_pick_cube \
--task="Pick up the cube and place it on the right" \
--duration=60Read more
Details• License: apache-2.0
• Training steps: 200,000 at batch size 32
• Optimizer: adam with learning rate 0.0001
• Hardware requirements: so_follower robot, two OpenCV cameras










Comments