Lucia 2B v1.2-nc
chain-of-thought image analysis
2 min read
A new LoRA adapter (a small add-on for a base model) for Qwen/Qwen3.5-2B that trains the language model to carefully examine images and output structured breakdowns: step-by-step thoughts, captions, tags, prompts, and Q&As. Version 1.2-nc is a non-commercial counterpart to the Lucia 2B v1.2 model and is trained on an expanded dataset of over 184,000 examples. Thanks to a special training objective, the model preserves base model behavior on standard text queries and only outputs breakdowns when needed. Useful for developers and researchers working on detailed image descriptions and multimodal data tasks.
Key features
- Trained on 184,562 examples from the
thought-symbolic-image-recaptioneddataset. - Maintains standard
Qwen3.5-2Btext-prompt behavior through a special training objective. - Supports variable analysis depth: from quick glances to detailed breakdown with critique and questions.
- Improved text recognition on images compared to the first version.
What you can do
- Use the adapter in local pipelines to generate detailed prompts, tags, and image descriptions.
- Automate visual data parsing in research projects (subject to the CC BY-NC-SA 4.0 non-commercial license).
- Integrate the model with
transformersandpeftlibraries to analyze photo and scene structure.
Example
import torch
from peft import PeftModel
from PIL import Image
from transformers import AutoModelForMultimodalLM, AutoProcessor
processor = AutoProcessor.from_pretrained("AbstractPhil/qwen3.5-2b-think-symbolic-image-nc")
model = AutoModelForMultimodalLM.from_pretrained("Qwen/Qwen3.5-2B", dtype=torch.bfloat16, device_map="cuda")
model = PeftModel.from_pretrained(model, "AbstractPhil/qwen3.5-2b-think-symbolic-image-nc").merge_and_unload().eval()
image = Image.open("picture.jpg").convert("RGB")
prompt = ("Look at this picture and think it through in writing, a closer look; then write a caption and a prompt or tags, "
"and the questions a careful looker would still ask, each as `question: what -> answer [record, chain or unknown]`.")
messages = [{"role": "user", "content": [{"type": "image", "image": image}, {"type": "text", "text": prompt}]}]
text = processor.apply_chat_template(messages, add_generation_prompt=True, tokenize=False, enable_thinking=False)
inputs = processor(text=[text], images=[image], return_tensors="pt").to(model.device)
out = model.generate(**inputs, max_new_tokens=800, do_sample=False)
print(processor.batch_decode(out[:, inputs["input_ids"].shape[1]:], skip_special_tokens=True)[0])
Read more
DetailsBuilt on Qwen/Qwen3.5-2B with a LoRA adapter trained for 21,815 steps.
Requires transformers 5 and peft 0.18 or newer, plus a CUDA-capable GPU with bfloat16 support.
Distributed under the CC BY-NC-SA 4.0 license (non-commercial use only due to the image dataset).










Comments