ACT policy for robotic manipulator
2 min read
Trained using the ACT method (Action Chunking with Transformers — an imitation learning method that predicts short chunks of actions instead of single steps), this model is built for the so-called so_follower robotic arm and designed to handle object manipulation tasks such as picking up cubes and placing them in a tray or stacking them on top of each other. The policy is based on teleoperation data and utilizes visual observations from a wrist camera. This solution is useful for robotics developers and researchers using the LeRobot ecosystem.
Key features
- Trained and deployed using the modern LeRobot library.
- Uses visual data from a wrist camera (
observation.images.wrist) at 640x480 resolution. - Predicts 6-dimensional vectorized actions (
action) based on state and images. - Built on a dataset containing recorded episodes of grasping and moving objects.
What you can do
- Run the policy on a real so_follower robotic arm for automated cube sorting.
- Deploy the model for autonomous execution of object grasping and stacking tasks.
- Fine-tune your own policy using the LeRobot framework and collected demonstration data.
Example
lerobot-rollout \
--strategy.type=base \
--robot.type=so_follower \
--robot.port= \
--robot.cameras="{ : {type: opencv, index_or_path: , width: 640, height: 480, fps: 30}}" \
--policy.path=stack \
--task="Pick up the cube and place it in the tray" \
--duration=60Read more
DetailsBenchmarks: success data not provided yet
Training: 100,000 steps, batch size 64, AdamW optimizer, learning rate 1e-05
Dataset: 82 episodes, 196,610 frames at 30 FPS










Comments