Skip to content
Robotics

pi05-agilex3-2bit

A 2-bit quantized version of π0.5 for the AgileX Piper robotic arm

3 min readupdated

The pi05-agilex3-2bit model by ForeverBlue is a 2-bit quantized (weight-compressed) version of agilex3_pi05 (a full-parameter fine-tune of π0.5 on three manipulation tasks, step 5999 EMA) built on the openpi library. It is designed for testing on a real AgileX Piper robot and benchmarking accuracy against the full-precision variant: input/output interfaces, commands, and the 10 Hz control frequency are identical to the original. Quantization was done via calibration only (on 256 demonstration observations with lighting and crop augmentations) with no additional fine-tuning, and the weights are saved unpacked in standard PyTorch format (model.safetensors) to run in a default openpi environment without code changes.

Key features

  • Aggressive 2-bit quantization: all 414 linear layers across the vision encoder, language model, and action expert (2.7B parameters) are compressed to an average of 2.016 bits per weight, while the embedding table is cast to INT8.
  • Full openpi compatibility: the model uses the same normalization statistics in norm_stats.json and plugs into existing agilex3_pi05.py scripts simply by changing the --checkpoint path.
  • Close to the original: the prediction deviation of the 2-bit version from the full-precision model is only 1.2x the natural variance of the original model itself when changing the initial noise seed.
  • Two integration modes: supports both calling the policy directly from the robot's Python code and running it over the network via a local policy server.

What you can do

  • Run A/B tests on a real AgileX Piper: alternate between the full-precision and 2-bit models across three tasks (cluster_grasp, cabinet_lemon, circle) using identical object layouts to measure real-world success rates.
  • Collect data for future calibration: record dual-camera streams, robot states, and commands while running the 2-bit model to improve subsequent quantization iterations.

Example

import os; os.environ.setdefault("JAX_PLATFORMS", "cpu")
import sys; sys.path.insert(0, "/path/to/agilex3_pi05")
from agilex3_pi05 import AgileXPi05Policy

policy = AgileXPi05Policy(checkpoint="/path/to/pi05-agilex3-2bit/checkpoint")
actions = policy.predict(fixed, wrist, state, instruction)  # (10, 7)
Read moreDetails
Offline tests (256 held-out observations): mean joint error increased from 0.0168 rad in the full-precision model to 0.0237 rad (17% of the stationary baseline error), gripper error went from 2.31 mm to 3.16 mm, and max single-step deviation was 0.217 rad.
The model.safetensors file size is 14.5 GB (unpacked weights for PyTorch compatibility; actual 2-bit layer footprint is 0.68 GB vs. 5.41 GB in BF16, though a custom runtime is not included in the repository).
Before running, you need to apply the transformers_replace patch for transformers 4.53.2 and set JAX_PLATFORMS=cpu.
The first predict call triggers torch.compile compilation (around 472 seconds on an RTX 6000 Ada), after which median inference time is 0.067 s.
Discuss Telegram 0

Will it run?

Working out the memory needs

The bot is still collecting this model's weight sizes; the estimate will appear here in a few minutes. Meanwhile you can rent a GPU with headroom.

Massed ComputeOpen Massed Compute

Run it on Massed Compute

The script downloads the model to the rented machine. How to run it is in the model card.

  1. 1. Rent a machine with a fitting GPU

    Open Massed Compute
  2. 2. Paste the script into the machine's terminal

    Connect over SSH (the Massed Compute panel shows the command) or open a terminal on the machine's desktop.

    HF_TOKEN / CIVITAI_TOKENThe script starts with token lines: paste yours between the quotes. The Hugging Face token is for gated models, the Civitai one for Civitai models.

    # ForeverBlue/pi05-agilex3-2bit
    # ===== Tokens: paste yours between the quotes =====
    export HF_TOKEN=""        # huggingface.co/settings/tokens, for gated models
    # ==========================================
    mkdir -p ~/models
    curl -LsSf https://astral.sh/uv/install.sh | sh
    source "$HOME/.local/bin/env"
    uv tool install "huggingface_hub[cli]"
    hf download ForeverBlue/pi05-agilex3-2bit --local-dir ~/models/pi05-agilex3-2bit
    # The model is in ~/models. How to run it is in the model card (link above).
    Add more LoRAs to pi05-agilex3-2bit
  3. 3. Use it

    The model is in ~/models. How to run it is in the model card (link above).

Stop the machine in the panel when you are done: it bills by the minute while it runs.

How to speed it up

Picked for this model type. Choose your hardware above to see what fits you exactly.

  • FlashAttention 44.0.0b40from November 18, 2026new release

    fastest exact attention on B200

    Kernels for Blackwell (beta). Exact attention without quantisation — fine for everything, LLMs included.

    How to enable: pip install flash-attn-4; vLLM and SGLang pick it up themselves.

    Earlier generations (2)
    • FlashAttention 3 — The Hopper (H100/H200) version with FP8.
    • FlashAttention 2 — The standard for RTX 30/40/50 and A100: exact attention without the memory cost of long contexts.
  • torch.compile2.15.0from October 28, 2026new release

    10–30% for free

    Compiles the model for your GPU. Slower first run, faster afterwards.

    How to enable: model = torch.compile(model); in ComfyUI the TorchCompileModel node.

Model family

New posts about versions of pi05-agilex3-2bit (quants, finetunes, LoRAs) will show up under the bell.

No known relatives of this model yet. All derivatives on Hugging Face

About the model

ForeverBlue/pi05-agilex3-2bit
Author
ForeverBlue
Category
Robotics
Released
Posted

On NeyroLearn

Hugging Face

00

Ask AI about this model

Answered by Gemini 4 · the chat is kept only in this tab

Comments