qwen3d_points_dist - Qwen-3D fine-tune for indoor change detection using point clouds
2 min readupdated
An experimental model based on Qwen-3D (3B) is designed to detect changes between an initial room point cloud and a new RGB-D frame (an image with depth data). It identifies which objects were moved or deleted, returning the output in JSON format along with the movement distance in meters. The architecture voxelizes the original points and uses a specialized voxel encoder combined with the visual transformer of the base model via 4D RoPE. Trained using LoRA (a lightweight adapter added to the base model), this model is useful for spatial intelligence and robotics researchers studying indoor environment changes.
Key features
- Based on Qwen-3D (3B) and trained on the vlm-change-detection-4k dataset.
- Uses a voxel encoder to encode points and color from the original point cloud.
- Applies LoRA with rank r=16 to adapt the weights of both the LLM and the encoder.
- Outputs a structured JSON response detailing actions (moved, deleted) and distance metrics.
What you can do
- Apply to spatial analysis tasks and indoor change monitoring using sensor data.
- Compare an initial room map against a new RGB-D frame within research pipelines.
- Integrate with the code from the pointcloud-voxel-fusion branch of the spatial_llm repository.
Read more
DetailsInitialization: katefgroup/Qwen-3D qwen3d_3b.pth
Training: LoRA r=16, alpha=32, 15,000 iterations on 1x NVIDIA RTX 5090 (~6.5 h)
Limitations: slow initial startup, encoder trained from scratch, large rooms lose some voxels due to the 6,000 token limit
License: CC BY-NC 4.0 (non-commercial use)










Comments