rimur01/diffusion_so101_assignment4_50k
diffusion policy for robotic manipulator
2 min read
The model implements the Diffusion Policy algorithm (an approach where robot control is framed as generating a sequence of smooth actions) for an so_follower type robotic arm. Trained on a dataset of 50 episodes, the model controls object gripping and placement into a target zone based on frames from two cameras and joint states. It was built using the LeRobot library for imitation learning in real-world robotics. The solution is suitable for researchers and developers testing open-source robotic arms.
Key features
- Diffusion Policy: generates multi-step smooth trajectories for contact manipulation tasks
- Multimodal input: processes robot state (6 degrees of freedom) and images from two cameras (cam0, cam1) in 3x480x640 format
- Robot compatibility: native integration for the so_follower robot type
- LeRobot tool: training and running via the Hugging Face LeRobot ecosystem version 0.6.0
What you can do
- Run the policy on a real so_follower robotic arm using the LeRobot command-line utility
- Test the task of picking up and moving objects to a target area
- Configure inference parameters capturing video streams from two USB cameras
- Use the dataset
rimur01/so101-assignment1-50-newto fine-tune your own policy variations
Example
Running the ready-made inference policy on the robot via the command line:
lerobot-rollout \
--strategy.type=base \
--robot.type=so_follower \
--robot.port= \
--robot.cameras="{ : {type: opencv, index_or_path: , width: 640, height: 480, fps: 30}, : {type: opencv, index_or_path: , width: 640, height: 480, fps: 30}}" \
--policy.path=rimur01/diffusion_so101_assignment4_50k \
--task="Pick up an object and place it in a target area" \
--duration=60Read more
DetailsLicense: apache-2.0
Training steps: 50,000 with batch size 1
Optimizer: adam (learning rate: 0.0001, seed: 1000)
Dataset: 50 episodes, 15,000 frames at 15 FPS










Comments