Harness VLA pi0.5 Real - robotics model with text memory
2 min readupdated
A checkpoint of the VLA model (Vision-Language-Action, combining vision, language, and action control) based on the pi0.5 architecture, trained on real robot data. The model features a text memory module (scheme C) and is designed for deployment and inference on robotic hardware. Training took 10,000 optimizer steps, and the checkpoint successfully passed validation upon reloading. Suitable for robotics researchers and engineers working with physical devices.
Key features
- Based on the pi0.5 architecture (Vision-Language-Action model)
- Added text memory (scheme C) for sequential task execution
- Trained on real robotics data totaling over 48 thousand rows
- Full set of inference parameters weighs about 13.4 GB
- Includes built-in weights and SAM 3-based tracker code for deployment
What you can do
- Run model inference using the included policy.py script
- Use the built-in SAM 3-based bowl tracker for grasping and manipulation tasks
- Set up a deployment cycle for a real robot using the real_deploy.py script
- Integrate configuration files and normalization statistics for integrity checking
Example
Example code for loading and running the model via policy.py can be found in the model repository under the source/ directory.
Read more
DetailsOptimizer steps: 10,000 (global batch 128)
Training data rows: 48,609
Final loss: 0.0041
Limitations: The model has not yet been tested on a real robot
Parameter weight: ~13.4 GB










Comments