Qwen3.81-27B
Merging Two Qwen3 Fine-Tunes
1 min readupdated
The model is a 50/50 linear parameter average of two Qwen3.5-based versions: the agent-terminal DaisyRose-27B and the multimodal sabi-noema with hybrid attention. Thanks to the orthogonality of their fine-tuning directions, the merge retains about 100% of the combined signal without losing knowledge. The model weighs 54.7 GB in bf16 format and is well-suited for programming, reasoning, and image tasks.
Key features
- Orthogonal merge: The fine-tuning directions of the two base models are perpendicular, allowing their experience to be combined successfully.
- Multimodality: Fully preserves the image processing architecture from the base Qwen3.5 lineup.
- Reasoning mode: Supports a chat template with a built-in deep thinking format.
- Quantization option: An NVFP4 version (19 GB) is available to run on a single GPU.
What you can do
- Run via vLLM: Deploy a local server to work with the model and long context.
- Solve terminal tasks: Use the strong agent skills inherited from DaisyRose.
- Multimodal analysis: Process queries combining text and images thanks to the hybrid architecture.
Example
vllm serve vince62s/Qwen3.81-27B \
--served-model-name qwen3.81 \
--reasoning-parser qwen3 \
--max-model-len 32768Read more
Details• GPQA Diamond: 43.9% (loglikelihood)
• VRAM requirements: ~55 GB+ for the bf16 version
• Parameters: 27.36 billion parameters, safetensors format (3 shards)
• Sampling: temperature 1.0, top_p 0.95










Comments