napalna/coarse-vla-pi05-assembly-10k - Fine-tuning of the $\pi0.5$ robotics model for part assembly in simulation
2 min readupdated
This model is an intermediate 10k-step checkpoint from the coarse-vla project, fine-tuned on top of lerobot/pi05_base. It controls a UR10e manipulator equipped with a Robotiq 2F-85 gripper to precisely insert four shaped pegs into a board within the MuJoCo simulator. The model handles gripping and transferring the parts, while a separate RL agent handles the final insertion. This release is useful for researchers working in robotics and robotic arm simulation using the LeRobot library.
Key features
- Base model
lerobot/pi05_base(LeRobot 0.6.1) with EMA weights in fp32 - Trained on 400 demonstrations (358k frames, 20 Hz) using two 224×224 cameras
- Full fine-tuning with a constant learning rate of 5e-5 after a 1k-step warmup
- Uses delta actions relative to the TCP pose with a horizon of 10 at 20 Hz
What you can do
- Apply the model in MuJoCo simulation for grasping and transferring shaped pegs
- Test the combination of $\pi0.5$ with an RL actor for precise part insertion
- Integrate the custom policy class
pi05_deltato work with delta actions
Example
To load and use the model, you need to import the specialized policy class from the coarse-vla project repository and use the standard LeRobot pretrained_model structure.
Read more
DetailsBenchmarks: $\pi0.5$ alone - 9% first-peg insertion, 0% all four; combined with RL actor - 88% and 56% respectively
Limitations: MuJoCo simulation only, real robots have not been tested
Training data: 400 scripted demonstrations, batch size 32, AdamW, bf16 autocast










Comments