X-VLA + Recap v1
robot control policy for cable insertion
2 min readupdated
The X-VLA + Recap v1 checkpoint trains a robotic arm for precision cable insertion in the EEE 598 AI for Industry Challenge (AIC). Built on the xvla-aic-v4 fine-tune for the LeRobot library, this 0.88B-parameter model is further fine-tuned using Recap (advantage-conditioned reinforcement learning) across 120 rollout recordings and 585 demonstrations. It achieved the highest total benchmark score, outperforming the base fine-tune as well as DSRL and residual RL variants. Useful for researchers and developers working in robotics and reinforcement learning.
Key features
- Scores 1163 points across 36 test trials in the AIC Gazebo simulator, beating the base
xvla-aic-v4fine-tune at 1052 points. - Takes feeds from three wrist-mounted cameras (256x288) alongside a 19-value state vector (TCP pose, velocities, wrist forces, and torques).
- Fine-tuned for 20k steps on the
aic-recap-v1dataset using one-second segments labeled withAdvantage: positiveandAdvantage: negativetags. - Runs in best-policy mode by appending the
" Advantage: positive"suffix to the task prompt.
What you can do
- Test the policy in the AIC Gazebo simulation environment on precision positioning and cable insertion tasks using the
eee598-aicproject scripts. - Use the checkpoint as a baseline policy or reference when benchmarking offline and advantage-conditioned fine-tuning methods in LeRobot.
Example
hf download muhammad-ibraheem/xvla-recap-v1 --local-dir ckpt/xvla-recap-v1
scripts/run_smolvla_server.sh ckpt/xvla-recap-v1Read more
DetailsBenchmark (36 trials in AIC Gazebo, max 100 points per attempt): 1163 points total (368 on Seed 100, 348 on Seed 101, 447 on training boards) and 2 full insertions.
Comparison: beats X-VLA + DSRL (1077 points), base
xvla-aic-v4 (1052 points), X-VLA + residual RL (1011 points), and the second iteration xvla-recap-v2 (949 points).Training: 20k steps on 120 X-VLA rollouts (top 30% and successful insertions labeled as positive) and 585 CheatCode demonstrations.










Comments