nberezny/smolvla_smoke
Robotics policy for uFactory Lite 6
2 min readupdated
This model is a specialized control policy for robots, trained using the LeRobot library (a machine learning toolkit for real-world robotics). Built on the compact SmolVLA vision-language-action architecture, it is designed for a specific manipulation task: sequentially stacking blocks of different colors. The policy takes mechanism states and images from three cameras as input and outputs control actions for the robot. This release will be useful for researchers and engineers working on imitation learning for robotics in simulation.
Key features
- Built on the efficient SmolVLA architecture (a compact vision-language-action model)
- Trained using the LeRobot framework for imitation learning tasks
- Processes visual data from three different camera angles (overhead, wrist, and state)
- Configured to work with the uFactory Lite 6 robot simulator
What you can do
- Run the ready-to-use control policy on a compatible robot or in simulation using LeRobot utilities
- Use the uaberezny/lite6_stack_dense dataset to study block stacking trajectories
- Fine-tune the model on your own demonstrations to solve similar manipulation tasks
Example
lerobot-rollout \
--strategy.type=base \
--robot.type=ufactory_lite6_sim_hybrid_dense_rel \
--robot.port= \
--robot.cameras="{ : {type: opencv, index_or_path: , width: 640, height: 480, fps: 30}, : {type: opencv, index_or_path: , width: 640, height: 480, fps: 30}}" \
--policy.path=nberezny/smolvla_smoke \
--task="stack the blocks: red at the bottom, yellow, blue on top" \
--duration=60Read more
DetailsLicense: apache-2.0
Base model: lerobot/smolvla_base
Dataset: 4,924 episodes, 143,843 frames at 20 FPS
Training parameters: 200 steps, batch size 32, adamw optimizer, learning rate 0.0001










Comments