WristDepth: metric depth for robot wrist cameras
2 min readupdated
The WristDepth model solves the problem of accurately determining scene depth in meters from a single image and focal length, specifically optimized for cameras on robotic manipulators at distances from 5 cm to 1.5 m. It is based on the Depth Pro 2 B architecture (0.1B parameters in size), fine-tuned on synthetic data for robotics specifics. Unlike the base model, which tends to overestimate distance several times over, WristDepth significantly reduces errors on real-world scenes and outputs an accurate depth map. The model will be useful for robotics engineers and researchers working with computer vision systems.
Key features
- Robot arm specialization: fine-tuned on synthetic data taking into account gripper visibility in the frame.
- Error reduction: decreases error on unseen scenes compared to the base version.
- Ready formats: besides PyTorch weights, provides ONNX graphs and TensorRT support for inference.
- Metric output: outputs depth directly in meters accounting for the camera's horizontal focal length.
What you can do
- Robotics integration: apply the model in a robot arm control pipeline to determine distance to objects.
- Export to ONNX/TensorRT: run optimized versions of the model in FP32, FP16, or INT8 formats for fast inference.
- Stream processing: use configurations with streaming and clips to analyze frame sequences.
Example
from depth_pro_2 import DepthPro2, load_rgb
import torch
model = DepthPro2.from_pretrained("christianengel/WristDepth", precision=torch.bfloat16).to("cuda").eval()
image, _ = load_rgb("wrist.jpg")
depth = model.infer(image, f_px=450.0)["depth"]Read more
DetailsBenchmarks: on the DROID test set, the AbsRel error is reduced from 1.445 to 0.255, and the scale is improved from 2.27 to 1.00.
Limitations: scale may vary depending on the setup, calibration for a specific camera is recommended.
Training details: 4,000 frames from BlenderProc procedural renders, self-distillation, and log-depth L1 + gradient matching loss function.










Comments