Marigold V2 albedo (ComfyUI)
extracting shadow-free surface color
2 min readupdated
Ready-to-use weights for estimating albedo (the base color of a surface without lighting, specular highlights, or shadows) from photos. This release combines the Marigold V2 model from researchers at EPFL, HUAWEI Bayer Lab, and the University of Bologna with the Qwen-Image-Edit-2509 base architecture. Unlike the original release, the base transformer here is quantized to 4-bit NF4 (weight compression to reduce VRAM usage), and all components are organized into standard ComfyUI folders. It is useful for 3D artists, photogrammetry specialists, and anyone working on scene relighting in ComfyUI or the Askiagraphy app.
Key features
- Compressed NF4 backbone: the
Qwen-Image-Edit-2509transformer is quantized to 4-bit via bitsandbytes (blocksize 64), while output projections and non-linear layers are kept in bf16 to preserve accuracy. - ComfyUI-ready folder structure: files are pre-sorted into the
diffusion_models,loras,vae, andembeddingsdirectories. - Comfy-Org compatibility: the LoRA adapter (a lightweight add-on for the base model), fine-tuned VAE decoder, and text embedding are byte-for-byte identical to the official Comfy-Org release.
- Permissive license: released under the Apache License 2.0, which allows commercial use.
What you can do
- Extract clean textures (albedo maps) from regular photos by stripping away cast shadows and light reflections.
- Use the resulting base color maps to relight objects or build materials for 3D scenes.
- Run the albedo estimation pipeline locally in ComfyUI on GPUs with limited VRAM thanks to the 4-bit transformer.
Example
To get started in ComfyUI, download the files from the repository and place them into their matching model directories:
models/diffusion_models/qwen_image_edit_2509_nf4.safetensors
models/loras/marigold_v2_albedo.safetensors
models/vae/marigold_v2_albedo_vae.safetensors
models/embeddings/marigold_v2_albedo_conditioning.safetensorsRead more
DetailsBase models: huawei-bayerlab/marigold-v2-0 and Qwen/Qwen-Image-Edit-2509
Quantization: bitsandbytes 0.48.2 (NF4, blocksize 64, without double quantization)
License: Apache License 2.0










Comments