allros/act-franka-rk3588s
ACT checkpoint for robotics and deployment on RK3588S
2 min readupdated
This release includes a PyTorch checkpoint and a compiled NPU version for RK3588/RK3588S chips, built on the LeRobot ACT framework (Action Chunking with Transformers, an architecture for controlling robotic arms). Designed for imitation learning and MuJoCo simulations, the weights let you run inference on low-cost boards via built-in NPU optimization. The package contains both the original weights after 50,000 training steps and a ready-to-use RKNN file in FP16 format. It is useful for robotics developers, embedded systems engineers, and anyone testing robotic arm algorithms on Rockchip processors.
Key features
- Two versions: original PyTorch weights (safetensors) and an optimized RKNN model (FP16, around 64.60 MiB) for RK3588 boards.
- Hardware acceleration: native NPU support on RK3588S boards for HTTP service inference.
- Ready-to-use preprocessors: input normalization configurations and parameters are already included.
- Fast inference: average request processing time on the board is around 26–27 ms.
What you can do
- Run a simulation: pair a PC running MuJoCo for rendering with an RK3588S board for NPU inference.
- Integrate into robotics: use the RKNN model to control physical or simulated Franka robotic arms.
- Run on PyTorch: load the weights via the
lerobotlibrary to experiment with the control policy. - Deploy an HTTP service: spin up an inference server on the board to send states and receive control actions remotely.
Example
from pathlib import Path
from huggingface_hub import snapshot_download
from lerobot.policies.act.configuration_act import ACTConfig
from lerobot.policies.act.modeling_act import ACTPolicy
from lerobot.policies.factory import make_pre_post_processors
path = Path(snapshot_download("allros/act-franka-rk3588s")) / "pytorch"
config = ACTConfig.from_pretrained(path)
config.device = "cpu"
config.pretrained_backbone_weights = None
policy = ACTPolicy.from_pretrained(path, config=config).cpu().eval()Read more
Details• Architecture: LeRobot ACT (Action Chunking with Transformers).
• Performance: average call time on an RK3588S board is 26.06–27.55 ms.
• Formats: safetensors (PyTorch) and FP16 RKNN.
• Limitations: tested only at a fixed position in MuJoCo simulation; randomization and deployment on real hardware require additional steps.










Comments