SmolVLA for SO-101 Pouring
bimanual robot control fine-tune
1 min readupdated
This is a fine-tuned version of the 0.45B-parameter lerobot/smolvla_base model built to control a bimanual SO-101 robot. It was trained on demonstrations of pouring liquids and granular materials. Taking feeds from three cameras alongside 12 joint states, the model outputs control actions for both robotic arms. It is aimed at robotics researchers and developers working with the lerobot framework.
Key features
- Built on
lerobot/smolvla_base(0.45B parameters). - Uses three high-resolution cameras (top-down view, left wrist, and right wrist).
- Supports bimanual control with 12-dimensional state and action spaces.
- Trained on 136 demonstration episodes (176,654 frames).
What you can do
- Automate liquid and powder pouring tasks on an SO-101 robotics setup.
- Trigger specific robot actions using text prompts, such as pouring water or powders.
- Drop the checkpoint into your own
lerobotexperiments to test bimanual control policies.
Example
Use the following text prompts to trigger specific tasks:
- Pour water into the cup. (right arm)
- Pour green tea latte powder from the green-lidded container into the cup. (left arm)
Read more
DetailsTraining: 40,000 steps with a batch size of 24.
Validation loss dropped from 0.101 to 0.0457.
These metrics reflect imitation loss rather than real-world task success rates on physical hardware.










Comments