act_franka_sweep_v3
Robot Control Policy for Sweeping Task
2 min readupdated
This model is a ready-to-use control policy for a robotic manipulator, trained using ACT (Action Chunking with Transformers — imitation learning method that predicts short sequences of actions instead of individual steps). Designed for the Franka Panda robot, it handles sweeping an orange cube using visual camera data and joint states. It was trained using the LeRobot library on teleoperation demonstration data and enables autonomous task execution on real hardware.
Key features
- Compatibility with the kinetic-type Franka Panda robot.
- Use of dual visual streams from the wrist camera (regular and depth).
- Training on a dataset of 49 episodes (6,842 frames at 10 FPS).
- Built on the ACT architecture using the LeRobot framework version 0.6.2.
What you can do
- Run the ready-to-use policy on a real Franka Panda robot to perform the cube-sweeping task.
- Fine-tune or use the model as a baseline for your own robotic imitation learning tasks.
Example
Running the policy on your robot using a terminal command:
lerobot-rollout \
--strategy.type=base \
--robot.type=franka_panda_kinesthetic \
--robot.port= \
--robot.cameras="{ : {type: opencv, index_or_path: , width: 640, height: 480, fps: 30}, : {type: opencv, index_or_path: , width: 640, height: 480, fps: 30}}" \
--policy.path=Matghost7/act_franka_sweep_v3 \
--task="Sweep the orange cube" \
--duration=60Read more
DetailsDataset: Matghost7/franka_sweep_cube_v3_merged
Training parameters: 50,000 steps, batch size 8, adamw optimizer, learning rate 1e-05
Input data: state (16,) and wrist images 3x480x640
Output data: actions of dimensionality (16,)










Comments