act_pick_and_place_tape_final_chunk50
pick-and-place policy for the SO-Follower robot
2 min readupdated
A compact 0.05B-parameter robotics policy trained with the LeRobot framework by knight7024. The model tackles the pick_and_place_tape task: picking up an object and moving it to a target spot using sensor readings and dual camera feeds. It is built on the ACT architecture (Action Chunking with Transformers — an imitation learning method that predicts short action sequences all at once rather than single steps). Alongside this version, the author also released chunk10 and chunk100 variants. It is a solid fit for developers and hobbyists experimenting with so_follower robotic arms and the LeRobot library.
Key features
- ACT imitation learning: predicts action chunks from teleoperation data for smoother manipulation.
- Multimodal inputs: takes a 6-element robot state vector
observation.stateof shape (6,) alongside video feeds from two cameras — an overhead camera (top, 240×320) and a wrist-mounted camera (wrist, 480×640). - Precise control: outputs a 6-dimensional
actionvector to drive the robotic arm's actuators. - Flexible planning horizons: alongside the
chunk50version, 10- and 100-step checkpoints are available to compare robot behavior.
What you can do
- Run on real hardware: deploy the policy on an
so_followerrobotic arm equipped with two cameras to test basic pick-and-place tasks. - Compare chunk lengths: benchmark
chunk50against the sibling checkpoints (chunk10andchunk100) on the same task to evaluate motion smoothness. - Use as a starting point: build on this setup and the
knight7024/pick_and_place_tape_finaldataset for fine-tuning on your own tasks in LeRobot 0.6.0.
Example
lerobot-rollout \
--strategy.type=base \
--robot.type=so_follower \
--robot.port= \
--robot.cameras="{ top: {type: opencv, index_or_path: 0, width: 320, height: 240, fps: 30}, wrist: {type: opencv, index_or_path: 1, width: 640, height: 480, fps: 30}}" \
--policy.path=knight7024/act_pick_and_place_tape_final_chunk50 \
--task="pick_and_place_tape" \
--duration=60
Read more
DetailsTrained on the
knight7024/pick_and_place_tape_final dataset: 50 episodes, 16,278 frames at 30 FPS.Training setup: 100,000 steps, batch size 1, AdamW optimizer (lr 1e-05), seed 1000, LeRobot 0.6.0.
Limitations: real-robot evaluation results have not been published in the model card yet; Apache-2.0 license.










Comments