act_stack_c50_h200_80k
robotic arm control policy
2 min readupdated
This model is trained with the ACT algorithm (Action Chunking with Transformers, an imitation learning method that predicts short action sequences instead of single steps) and the LeRobot library to control an so_follower robot. Its task is to stack red, yellow, and purple cubes onto a designated spot on a table. The policy takes the robot's state and high-resolution wrist camera feed as input to output control signals. Trained on a 74-episode dataset, it is aimed at robotics researchers working with hardware compatible with the LeRobot ecosystem.
Key features
- Robotics: Built for a physical so_follower robotic arm.
- Computer vision: Uses 640x480 wrist camera input (`observation.images.wrist`).
- ACT architecture: Predicts action chunks via imitation learning.
- Dataset: Trained on 74 episodes (over 100k frames) for color-coded cube stacking.
What you can do
- Run on a robot: Execute the cube-stacking task using the `lerobot-rollout` command.
- Study the training setup: Reuse the configuration to train your own manipulation policies.
- Inspect the dataset: Explore the recorded demonstrations via Hugging Face Spaces visualizers.
Example
lerobot-rollout \
--strategy.type=base \
--robot.type=so_follower \
--robot.port= \
--robot.cameras="{ : {type: opencv, index_or_path: , width: 640, height: 480, fps: 30}}" \
--policy.path=asma-4a/act_stack_c50_h200_80k \
--task="Stack the red, yellow and purple cubes on the table mark" \
--duration=60Read more
DetailsTraining steps: 80000
Batch size: 32
Optimizer: adamw (learning rate: 1e-05)
LeRobot version: 0.7.1
Input features: observation.state (6,) and observation.images.wrist (3, 640, 480)










Comments