Qwen3.5-2B-NoRA
A model for reasoned action analysis from frames
2 min readupdated
The model is built on the Qwen/Qwen3.5-2B architecture (2.21 billion parameters) and fine-tuned on NoRA annotations for normative reasoning based on first-person visual scenes. Using preceding frames, the model describes observable facts, the underlying reasons derived from them, and potential subsequent actions with cross-links. This development is designed for research tasks in multimodal behavior and logic analysis. It will be useful for AI researchers and computer vision developers studying decision-making in visual environments.
Key features
- Based on the efficient Qwen3.5-2B language model
- Trained on GPT-5.4 annotations from the LLMSilver-1230 dataset
- Full fine-tuning completed using the MS-SWIFT tool
- Builds structured connections between facts, reasons, and actions
What you can do
- Analyze first-person video sequences for research projects
- Generate detailed structured JSON scene descriptions with action reasoning
- Integrate the model into image and text processing pipelines via the transformers library
Example
import torch
from transformers import AutoModelForImageTextToText, AutoProcessor
name = "MINTLABJHUANU/Qwen3.5-2B-NoRA"
processor = AutoProcessor.from_pretrained(name)
model = AutoModelForImageTextToText.from_pretrained(
name, torch_dtype=torch.bfloat16, device_map="auto")
SYSTEM_PROMPT = (
"Describe a reasonable next-action decision from the camera wearer's "
"perspective. Use only the visible scene. Return one JSON object with "
"clip_id, facts, reasons, and actions. Return JSON only."
)
USER_PROMPT = "Create a NoRA annotation for clip_id `{clip_id}` from these pre-action frames."
messages = [
{"role": "system", "content": [{"type": "text", "text": SYSTEM_PROMPT}]},
{"role": "user", "content": [
{"type": "image", "url": "frames.jpg"},
{"type": "text", "text": USER_PROMPT.format(clip_id="example")},
]},
]
inputs = processor.apply_chat_template(
messages, add_generation_prompt=True, tokenize=True,
return_dict=True, return_tensors="pt", enable_thinking=False,
).to(model.device)
output = model.generate(**inputs, max_new_tokens=2048, do_sample=False)
print(processor.decode(
output[0][inputs["input_ids"].shape[1]:], skip_special_tokens=True))
Read more
DetailsTraining method: Full fine-tuning with MS-SWIFT
Epochs and learning rate: 3 / 1e-5
Batch size and gradient accumulation: 1 / 16
Precision and token limit: BF16 / 4,096 tokens
Limitations: The model is intended for normative reasoning research, is not a safety system, and must not be used for making decisions about people.










Comments