Iris-Z
a unified image and depth map generation model
2 min readupdated
Built on FLUX.2 by Speridlabs, Iris-Z is a generative model that simultaneously produces a visual image and its underlying geometry (depth map). Using a single set of weights, it handles text-to-RGBD, image-to-depth, and depth-to-image tasks. It outperforms leading dedicated depth estimators on standard benchmarks while preserving the generation quality of its base architecture, making it a strong fit for researchers, developers, and creators working in 3D graphics and computer vision.
Key features
- Dual output: Generates both visual appearance and object geometry simultaneously from a single text prompt.
- High accuracy: Beats top dedicated depth models on standard benchmarks like NYUv2 and ETH3D.
- Flexible pipeline: Supports text-to-image, text-to-RGBD, image-to-depth, and depth-to-image workflows.
- Two model sizes: Comes as the 32.2B-parameter Iris-Z-big and the lighter 9.1B-parameter Iris-Z-small.
What you can do
- Text-to-RGBD: Generate a complete image alongside its matching depth map for 3D scenes straight from a text description.
- Photo depth estimation: Extract detailed depth maps from an existing photo or batch-process an entire folder of images.
- Depth-guided generation: Create new images guided by an existing depth map and a text prompt.
- Python API integration: Plug the model directly into custom graphics pipelines using the official SDK.
Example
from iris_z import IrisZPipeline
pipeline = IrisZPipeline.from_pretrained("speridlabs/iris-z", variant="big")
# Генерация картинки и карты глубины по тексту
rgbd = pipeline.text_to_rgbd("a lighthouse at dusk", seed=0)
# Получение карты глубины из картинки
depth = pipeline.image_to_depth("photo.jpg")
depth.colourized().save("photo_depth.png")Read more
DetailsAbsRel x100 benchmarks (lower is better): NYUv2 (Iris-Z-big: 1.90/2.28), ETH3D (Iris-Z-big: 1.76/1.87), depending on the evaluation protocol.
VRAM requirements: ~112 GB for the big version and ~33 GB for the small version across all tasks.
Requires accepting the base FLUX.2-dev model license and logging in via hf auth login.








Comments