chomeed/task2_full_grc_subtask_rel_chunk30_bs128_1120_40k
a pi0.5 model checkpoint for the robotic cable insertion task
2 min readupdated
This model is a checkpoint (at 40,000 steps) of the pi0.5 robotics policy, fine-tuned on a demonstration dataset for cable insertion in the GRC task using the LeRobot framework. It takes images from three cameras and an 18-dimensional state, predicting intermediate subtasks with a built-in VLM (Vision-Language Model) and outputting an action sequence for the manipulators. The model is tailored for researchers and engineers working on robot control using the LeRobot library.
Key features
- Base model: Based on lerobot/pi05_base using the pi05_subtask plugin.
- Inputs: Uses data from three cameras (two d405 and one zed_mini) and an 18-dimensional state vector.
- Subtask prediction: The VLM records the current subtask, after which the action expert builds the trajectory.
- Training parameters: Batch size 128 (64 per GPU x 2 B200), AdamW optimizer, bf16 precision.
What you can do
- Run policy: Load the checkpoint via the PI05SubtaskPolicy class to control the robotic setup.
- Hardware integration: Pass camera data and joint states to perform the cable insertion task.
- Test subtasks: Use subtask prediction to automate multi-stage manipulation tasks with manipulators.
Example
import torch, lerobot_policy_pi05_subtask
from lerobot.policies.factory import make_pre_post_processors
from lerobot_policy_pi05_subtask import PI05SubtaskPolicy
policy = PI05SubtaskPolicy.from_pretrained("chomeed/task2_full_grc_subtask_rel_chunk30_bs128_1120_40k")
pre, post = make_pre_post_processors(policy.config, pretrained_path="chomeed/task2_full_grc_subtask_rel_chunk30_bs128_1120_40k")
pad = torch.zeros(18, dtype=torch.bool)
batch = pre({"observation.state": state18, "observation.images.d405_left": img_left, "observation.images.d405_right": img_right, "observation.images.zed_mini": img_zed, "task": "insert the cable into the control module", "state_dim_is_pad": pad})
actions = post(policy.predict_action_chunk(batch))Read more
DetailsFramework: LeRobot 0.6.2 pi05_subtask
Training: 40,000 steps, train loss 0.002
Hardware: 2 x B200 GPU (DDP)
Action space: 18-dimensional, chunk 30 steps










Comments