Qwen3.5-9B CyberSecurity (Abliterated)
a cybersecurity model without unnecessary refusals
2 min readupdated
This multimodal model (takes images and text as input, outputs text) is built for vulnerability analysis and information security tasks. It uses unsloth/Qwen3.5-9B (9.41 billion parameters) as its base, merged with jeonjw's Qwen3.5-9B-CyberSecurity-LoRA adapter (a lightweight fine-tuning add-on). Its standout feature is abliteration (removing the refusal direction vector from the model's weights to prevent standard refusals on security-related queries). It is a solid fit for security researchers, pentesters, and developers working in authorized environments.
Key features
- Adapter merge: The specialized cybersecurity LoRA is merged into the base model in fp16 format.
- Weight abliteration: The refusal direction was computed via activation differences and projected out of the
self_attn.o_proj,linear_attn.out_proj(in 24 of the 32 hybrid attention layers), andmlp.down_projmatrices atscale = 1.0. - Intact vision: The vision tower remains untouched, keeping the model's multimodal capabilities intact.
- Checkpoint details: The MTP (Multi-Token Prediction) head is missing, so converting to GGUF requires the
--no-mtpflag (a pre-built GGUF release is also available separately).
What you can do
- Break down how specific vulnerabilities work (such as format string bugs) and get remediation guidance.
- Power local assistants for code security reviews and authorized penetration testing.
- Run it on local hardware via
transformersor grab the standalone GGUF build for local runners.
Example
import torch
from transformers import AutoModelForImageTextToText, AutoProcessor
model_id = "jeonjw/Qwen3.5-9B-CyberSecurity-Abliterated"
processor = AutoProcessor.from_pretrained(model_id)
model = AutoModelForImageTextToText.from_pretrained(model_id, dtype=torch.bfloat16, device_map="auto")
messages = [{"role": "user", "content": "Explain how a format string vulnerability works and how to remediate it."}]
inputs = processor(text=[processor.apply_chat_template(messages, tokenize=False, add_generation_prompt=True, enable_thinking=False)], return_tensors="pt").to(model.device)
print(processor.decode(model.generate(**inputs, max_new_tokens=512, do_sample=False)[0][inputs["input_ids"].shape[1]:], skip_special_tokens=True))
Read more
DetailsRefusals: 17% across 6 offensive security test prompts (using greedy decoding and
enable_thinking=False, evaluated by keywords).Limitations: Abliteration removes only a single direction per layer, so some refusals remain; safety filters are intentionally weakened.
Intended use: Strictly for legitimate research, vulnerability analysis, and defensive work in authorized environments.










Comments