ovb-b-17500-best-full
standalone Qwen-Image-2.1 pipeline with baked-in LoRA
2 min readupdated
A ready-to-use QwenImage21Pipeline (7.12B parameters) for image-to-image editing and analysis. It takes an RGB image and a text instruction to output a fixed-palette depth map, perform semantic or instance segmentation, or generate a new image. Released by gatilin, it merges the Melo111/Fusion-C1-KQ0r128-60-40 base model with the ovb-i108-b LoRA adapter (a lightweight add-on trained on top of a base model) at training step 17,500. Unlike the standalone adapter, the weights are baked directly into the main transformer, so you don't need to download the base model or load the adapter separately at runtime.
Key features
- Fully self-contained: includes the merged
bfloat16transformer, frozen text encoder, VAE, tokenizer, and scheduler. - Clean weight merge: fused via PEFT's
merge_and_unload(safe_merge=True)across 224 modules (including attention layersto_q,to_k,to_v, andimg_mlp) from an original rank-64 rsLoRA. - Multi-task support: handles depth map visualization, segmentation (semantic, instance, and referring/prompt-guided), and prompt-based image generation.
- Fine-tuning ready: the transformer component can be loaded on its own as a clean initialization checkpoint for a new training run.
What you can do
- Generate depth maps and segmentation masks: feed RGB photos with open-vision-banana project prompts to produce visual predictions.
- Run locally with minimal dependencies: load the pipeline in
diffusersscripts with CPU offloading (enable_model_cpu_offload) without fetching parent repositories. - Use as a fine-tuning base: extract the
transformermodule and start fresh training runs without leftover optimizer states.
Example
import torch
from diffusers import QwenImage21Pipeline
repo = "gatilin/ovb-b-17500-best-full"
pipe = QwenImage21Pipeline.from_pretrained(repo, torch_dtype=torch.bfloat16)
pipe.enable_model_cpu_offload()
Read more
DetailsExport verification: checked SHA-256 hashes for all files, tensor loading accuracy, and LoRA merge math across every module.
Limitations: full offline pipeline execution and image generation were not tested by the author after merging (
image_inference: false), and benchmark scores were not re-evaluated.License: governed by the Qwen Research License (for research and evaluation only; non-commercial use).










Comments