LiteCalib ViT-B
Fast single-image camera calibration
2 min readupdated
The LiteCalib model, built on the DINOv2 ViT-B/14 backbone (a vision transformer with 106M parameters), tackles single-view camera calibration. It estimates the vertical field of view (vFoV) and optical distortion parameters from a single static image using symmetric camera models. This development will be useful for computer vision researchers, 3D reconstruction creators, and augmented reality app developers who need to recover scene geometry without special calibration patterns.
Key features
- DINOv2 backbone: Uses a powerful visual foundation for feature extraction.
- High speed: Frame processing takes just 6.3 ms on an NVIDIA A100 (fp16).
- Accuracy: The median angular error is 1.50° according to the paper benchmarks.
- TensorRT support: Optimized for running on edge devices like the Jetson Orin Nano.
What you can do
- Geometry analysis: Determine the field of view and optical distortions for any single snapshot.
- Integration into 3D pipelines: Use calibration as a preprocessing step for scene reconstruction or photogrammetry.
- Hardware deployment: Deploy the model on robotic or embedded modules via TensorRT for real-time operation.
Example
import litecalib
model = litecalib.load("litecalib_vitb")
calib = model.calibrate("photo.jpg", "radial:1")
print(calib.K, calib.distortion)Read more
DetailsMedian angular error: 1.50°
Median vFoV error: 3.20°
Performance: 6.6 ms total on NVIDIA A100 (PyTorch fp16) and 27.1 ms on Jetson Orin Nano 8 GB (TensorRT fp16)
Training: 24 epochs on OpenPano, CommonsPano, and MegaScenes data
License: Apache License 2.0










Comments