pi05-libero-goal-bowl_on_plate
teaching a robot to place a bowl on a plate
2 min readupdated
A robotic arm control model fine-tuned for a specific household task: picking up a bowl and placing it on a plate in the LIBERO-goal simulator. It builds on the 4.14B-parameter lerobot/pi05_base architecture using full SFT (Supervised Fine-Tuning — updating all model weights without freezing layers or using LoRA). Unlike the general-purpose base version, this checkpoint is tailored strictly to a single action and includes intermediate saves alongside optimizer states, not just the final weights. It is designed for robotics researchers and LeRobot framework users looking to reproduce experiments or resume training.
Key features
- Full fine-tuning: all 4,143,404,816 model parameters were trained in FP32 precision with BF16 autocast and the AdamW optimizer.
- Vision-action processing: takes 256×256 images from two cameras (plus one masked input) and generates 50-step action sequences using 10 flow-matching iterations (a method for generating smooth trajectories).
- Complete checkpoint set: the repository includes saves at steps 250, 500, 750, and 1000, bundled with
training_stateso you can resume training right where it left off. - PaliGemma compatibility: handles text instructions using the official Big Vision PaliGemma vocabulary.
What you can do
- Run the
PI05Policyin the LIBERO-goal simulation environment (task ID: 8) to evaluate how reliably it places the bowl onto the plate. - Load any intermediate checkpoint along with its optimizer state to continue fine-tuning on your own demonstrations in LeRobot.
- Compare task performance across different training stages using the raw evaluation logs included in the repository.
Example
from huggingface_hub import snapshot_download
from lerobot.policies.pi05.modeling_pi05 import PI05Policy
root = snapshot_download("qrvmil/pi05-libero-goal-bowl_on_plate-20261116", allow_patterns="checkpoints/000250/pretrained_model/*")
policy = PI05Policy.from_pretrained(root + "/checkpoints/000250/pretrained_model")
Read more
DetailsSuccess Rate (5 trials, 300-step limit): 20% (1/5) at step 250, 0% at step 500, and 60% (3/5) at step 750; step 1000 evaluation is currently in progress.
Training: 1000 steps across 49 demonstrations (4,563 frames), batch size 8, learning rate 5e-5 with cosine decay.
Control: relative end-effector control at 20 Hz, executing 10 out of 50 predicted actions per step.










Comments