HITCH
controlling the Unitree G1 humanoid robot via VLM
2 min readupdated
This repository contains two vision-language models (VLMs — AI models that process images and text together) built to control the Unitree G1 humanoid robot through the HITCH framework. Fine-tuned from Qwen3.8-27B by a research team (Lu et al.), both versions are configured to respond immediately without outputting a long reasoning trace. Unlike standard multimodal models, HITCH interacts directly with robot body-control tools in simulation and the real world. This release is aimed at developers working in robotics and embodied AI.
Key features
- Two versions in one repository: the base
HITCH-27B(used on the physical robot) andHITCH-27B-SIMPLE(further trained on task trajectories from the SIMPLE benchmark). - Direct response generation with no intermediate reasoning trace for faster latency when calling control tools.
- Built on Qwen3.8-27B with support for up to 262,144 context tokens and up to 512 images per prompt when run with vLLM.
- Open Apache-2.0 license, inherited from the base model.
What you can do
- Spin up a local inference server via vLLM and connect it as a backend to control a physical Unitree G1 robot.
- Run and test the agent in a simulator on object manipulation tasks (such as
tabletop_pick) with visualization through the built-in viewer. - Use the
HITCH-27B-SIMPLEvariant to evaluate and reproduce experiments on SIMPLE benchmark tasks.
Example
hf download Axellwppr/HITCH --include "HITCH-27B/*" --local-dir hitch
vllm serve hitch/HITCH-27B --served-model-name hitch --port 8000 \
--reasoning-parser qwen3 --enable-auto-tool-choice --tool-call-parser qwen3_coder \
--max-model-len 262144 --limit-mm-per-prompt '{"image": 512, "video": 0}'
Read more
DetailsBase model: Qwen/Qwen3.8-27B.
Architecture and format: transformers, image-text-to-text task.
License: Apache-2.0.
Benchmarks and exact VRAM requirements are not specified in the model card.










Comments