PerceptronAI/Isaac-0.5-YAM
a policy for dual-arm robots
2 min read
This new model is a fine-tuned version of Isaac 0.5 trained on dual-arm YAM demonstrations from xDoF ABC and MolmoAct2. The policy takes inputs from three RGB cameras, a text instruction, and the current joint states of the manipulators, then predicts target joint and gripper values for both arms. The checkpoint was saved after 200,000 steps of fine-tuning across 32 GPUs. It is built for robotics developers and researchers working with the lerobot library.
Key features
- Fine-tuned on dual-arm YAM demonstrations (xDoF ABC and MolmoAct2).
- Processes three RGB camera feeds (a wide-angle view and two wrist-mounted cameras).
- Predicts absolute target joint and gripper values for both arms.
- Outputs an action chunk of size 60 by 14 for each observation.
What you can do
- Run policy inference on custom or recorded observations using Python.
- Fine-tune the model on a custom LeRobot dataset using two GPUs with CPU offload.
- Integrate the model into projects involving dual-arm robotic manipulator control.
Example
import json
from pathlib import Path
import torch
from lerobot.policies.factory import make_pre_post_processors
from lerobot.policies.perceptron_isaac import PerceptronIsaacPolicy
from torchvision.io import decode_image
snapshot = Path("./Isaac-0.5-YAM")
assets = snapshot / "assets"
sample = json.loads((assets / "sample_observation.json").read_text())
Read more
DetailsTakes three RGB cameras, arm states, and a task prompt
Outputs an action chunk of 60 by 14
Trained on 32 GPUs with a global batch size of 256 sequences










Comments