WeaveMem YAM 10K
Inference service for robotics models
2 min readupdated
The package contains three native π₀.₅ models trained on the YAM robotics dataset. The server accepts camera frames, robot state, and instructions via WebSocket, returning an array of 50 predicted actions for 14 degrees of freedom. Decisions are based on Orbax inference parameters and include a frozen OpenPI runtime, tokenizer, and CD-LAM encoder. The model is designed for researchers and engineers working on robotic manipulator control.
Key features
- Support for three checkpoints with various sync and async modes (sync, kv, async_lag5).
- Processing data from multiple cameras and a 14-dimensional robot state.
- Built-in WebSocket server for fast transmission of commands and observations.
- Use of the CD-LAM encoder for working with movement history.
What you can do
- Deploy the inference server on Linux with an NVIDIA GPU and run robot control.
- Set up a Python client to send telemetry and receive action arrays [50, 14].
- Integrate asynchronous modes with a 5-frame lag for smooth real-time operation.
Example
from websockets.sync.client import connect
from openpi_client import msgpack_numpy
with connect("ws://127.0.0.1:8765", compression=None, max_size=None) as ws:
metadata = msgpack_numpy.unpackb(ws.recv())
packer = msgpack_numpy.Packer()
call = lambda msg: (ws.send(packer.pack(msg)), msgpack_numpy.unpackb(ws.recv()))[1]
call({"reset": True, "seed": 42})
Read more
DetailsHardware requirements: Linux x86-64, Python 3.11, NVIDIA GPU with CUDA 12 support (tested on H100).
Communication protocol: binary MessagePack over WebSocket.
Action format: left arm (6 joints + gripper), right arm (6 joints + gripper).










Comments