hackathon-team6-cubicasa-ae
reverse image search for similar floor plans
2 min readupdated
A convolutional autoencoder (an AI model that compresses an image into a compact numerical vector and reconstructs it back) built by a student team from IAAC MaAI 2026/27. The model encodes a 128×128 pixel architectural floor plan into a 128-number code: layouts with similar shapes and proportions end up close together in vector space, enabling instant similarity search. The repository already includes precomputed vectors for 5,000 real house plans from the CubiCasa5K dataset, while the model itself weighs just 4.5 MB in ONNX format (an open standard for fast AI model runtime) and runs smoothly on a standard CPU. It is a handy tool for architects and students looking to quickly source references based on overall building geometry.
Key features
- Ultra-lightweight architecture: 1.17M parameters with ONNX and PyTorch weights, allowing training and inference without a heavy GPU.
- Dual outputs: returns both a 128-dimensional
codevector for distance-based search and a reconstructedreconstructionimage. - Ready-to-use search database: bundles precomputed
collection_codes.npyembeddings covering 5,000 mostly Finnish residential floor plans. - Outperforms classical baselines: when a plan is shifted by 3 pixels with added noise, it retrieves the original 69% of the time, compared to 25% for PCA and 4% for raw pixel matching.
What you can do
- Find architectural analogs: upload a sketch or blueprint to pull the top 5 CubiCasa5K floor plans with matching contours and proportions.
- Visualize and cluster collections: generate UMAP maps of large blueprint archives, grouping layouts by aspect ratio, footprint area, and line density.
- Embed into web services: drop the 4.5 MB ONNX file into a local app or Telegram bot for instant floor plan reference lookup.
Example
session = ort.InferenceSession(hf_hub_download(repo, "floorplan_ae.onnx"))
collection = np.load(hf_hub_download(repo, "collection_codes.npy"))
ids = json.load(open(hf_hub_download(repo, "collection_ids.json")))
code, reconstruction = session.run(None, {"image": preprocess(plan_path)})
distances = np.linalg.norm(collection - code, axis=1)
for i in np.argsort(distances)[:5]:
print(ids[i], round(float(distances[i]), 1))
Read more
DetailsMetrics (CubiCasa5K test split, 400 plans): Test MSE 0.0131 (vs. 0.0153 for the 32-dimensional version), Retrieval top-1 at a 3 px shift — 69% (up to 98% on high-contrast scans, 28% on faint ones).
Strict preprocessing pipeline: grayscale conversion, color inversion (white walls on a black background), black padding to a square, Lanczos resize to 128×128, and [0, 1] normalization.
Limitations: 128×128 resolution drops doors, furniture, and text labels; the model is not rotation-invariant and remains sensitive to scan line brightness.
License: CC BY-NC-SA 4.0 (non-commercial use only).










Comments