SPEED+ Pose Estimator: Checkpoints for Spacecraft Pose Estimation Research
2 min readupdated
The model is designed to estimate the 6DoF (six degrees of freedom) pose of the Tango spacecraft from a single image. The architecture combines a ResNet-50 backbone and a fully connected head (MLP head), trained exclusively on synthetic data from the SPEED+ benchmark. The weight set includes 17 experimental checkpoints with different seeds and augmentation options for studying transfer from simulator to real domains (Lightbox and Sunlamp). The tool targets researchers studying model robustness and the simulator misspecification problem.
Key features
- Direct 6DoF pose regression based on ResNet-50 and an MLP head.
- Training exclusively on the synthetic SPEED+ dataset (28,000 images).
- 17 experimental checkpoints with various seeds and augmentation settings.
- Result reproducibility for analyzing the sim-to-real gap.
What you can do
- Run the results table reproduction script to verify the research.
- Test model inference on images of the Tango spacecraft.
- Compare the accuracy of models with a frozen backbone and a trainable layer 4.
Example
import torch
from huggingface_hub import hf_hub_download
from PIL import Image
from speedplus_pose.model import SpacecraftPoseEstimator
from speedplus_pose.normalisation import TranslationNormaliser
from speedplus_pose.transforms import build_eval_transform
repo = "lkid08/spacecraft-pose-estimation"
hf_hub_download(repo, "config.json")
path = hf_hub_download(repo, "unfrozen_aug_seed42.pt")
checkpoint = torch.load(path, weights_only=False, map_location="cpu")
model = SpacecraftPoseEstimator()
model.load_state_dict(checkpoint["model_state_dict"])
model.eval()
normaliser = TranslationNormaliser(checkpoint["train_means"], checkpoint["train_stds"])
image = Image.open("img000001.jpg")
tensor = build_eval_transform()(image)
with torch.no_grad():
output = model(tensor.unsqueeze(0))
translation = normaliser.remove(output[:, :3])
quaternion = output[:, 3:]
quaternion = quaternion / quaternion.norm(dim=1, keepdim=True)
print(translation, quaternion)Read more
DetailsBenchmarks (orientation error E_R): layer 4 backbone with augmentation shows an error of 0.987 rad on Lightbox.
Hardware requirements: training was performed in Google Colab and on Apple M5.
Limitations: the model is not intended for real-world spaceflight use, accuracy on real data drops, and model confidence remains high during erroneous predictions.
Training details: input size 320x512 in grayscale, target object is the Tango spacecraft.










Comments