HRL-Group/stack_100
policy for robotic manipulators
2 min readupdated
This is a ready-to-use policy (control model) for robotics, trained using the LeRobot framework on a given dataset. The model uses the ACT method (Action Chunking with Transformers — an imitation learning approach that predicts short sequences of actions instead of individual steps) to perform block manipulation tasks. It takes robot state data and an image from a wrist camera as inputs, and outputs control commands for the manipulator. The project targets researchers and developers working with physical robots like so_follower.
Key features
- Trained via the ACT method for efficient action sequence prediction
- Uses visual data from a wrist camera and robot joint state data
- Designed to work with the so_follower hardware configuration
- Based on a dataset of 92 episodes (over 218,000 frames at 30 FPS)
What you can do
- Run the ready-to-use control policy on a real robot using LeRobot utilities
- Fine-tune your own model on a similar dataset for new manipulation tasks
- Integrate the model into custom robotic scenarios involving object grasping and movement
Example
Running the ready-to-use policy on a robot via the command line:
lerobot-rollout \
--strategy.type=base \
--robot.type=so_follower \
--robot.port= \
--robot.cameras="{ : {type: opencv, index_or_path: , width: 640, height: 480, fps: 30}, : {type: opencv, index_or_path: , width: 640, height: 480, fps: 30}}" \
--policy.path=HRL-Group/stack_100 \
--task="Pick up one cube and stack it on top of the other cube" \
--duration=60Read more
DetailsTraining parameters: 100,000 steps, batch size 16, adamw optimizer, learning rate 1e-05.
Inputs: observation.state with shape (6,) and observation.images.wrist with shape (3, 480, 640).
Outputs: action with shape (6,).
Dataset: 92 episodes, frame rate 30 FPS.










Comments