TASK_01_bimanual_cube_transfer_teleop_pi05_LoRA
Robotic Arm Control Model
2 min readupdated
A new vision-language-action model built on the pi05 architecture by Physical Intelligence for the LeRobot robotics platform. It is trained to control a bimanual robot for a complex manipulation task: picking up a cup with the right hand, moving it to the center, and placing it into a box with the left hand. The model is adapted for Fairino-type arms and processes data from three security cameras along with the robot's current state. This is a useful tool for engineers and researchers working on practical robot training using imitation learning.
Key features
- Specialization: Trained on a precise two-handed object transfer task using Fairino robots.
- Multimodality: Processes visual data from three cameras (top, left, right) and system states.
- LeRobot framework: Full integration with the Hugging Face LeRobot ecosystem for training and inference.
- Training: The model was trained on a dataset of 75 episodes (49,128 frames) using the AdamW optimizer.
What you can do
- Run on a robot: Deploy the ready-made policy on a real Fairino robot to automate assembly or object transfer.
- Data analysis: Explore the demonstration dataset and movement structure in the training episodes via the LeRobot visualizer.
- Fine-tuning: Use the lerobot/pi05_base base model to create custom robotic skills.
Example
Command to run the policy on a real robot:
lerobot-rollout \
--strategy.type=base \
--robot.type=Fairino \
--robot.port= \
--robot.cameras="{ : {type: opencv, index_or_path: , width: 640, height: 480, fps: 30}, : {type: opencv, index_or_path: , width: 640, height: 480, fps: 30}}" \
--policy.path=Bekhzod/TASK_01_bimanual_cube_transfer_teleop_pi05_LoRA \
--task="pick up the cube with the right arm, place it in the middle, then put it in the box with the left arm." \
--duration=60Read more
DetailsLicense: apache-2.0
Base model: lerobot/pi05_base
Training configuration: 20,000 steps, batch size 32, learning rate 0.001, seed 1000
Input parameters: state (14,) and images from three cameras (3, 480, 640)
Output parameters: action vector (14,)










Comments