SEL Qwen 9B
accurate retrieval of relevant snippets in text and images
2 min readupdated
SEL Qwen 9B is an adapter for the multimodal Qwen3.5-9B model by spock-oss built for targeted information extraction. You feed the model a question along with text, an image, or both, and it outputs relevance scores for every input text token and image patch. Instead of generating an answer token by token, the model runs in a single forward pass through a dedicated dense selection head. The release includes a rank-32 LoRA adapter (a lightweight add-on on top of the base model) and a trained selection head, while the language backbone itself is quantized to NF4 on load. It is a solid fit for developers building RAG systems and pipelines that need to pinpoint exact answers across documents and visual data.
Key features
- Single forward pass: scores the relevance of every snippet at once without slow autoregressive text generation.
- Multimodal analysis: works with text files, images, or both together, scoring individual visual patches.
- Hybrid attention: 8 full-attention layers in the model are converted to bidirectional, while the remaining 24 gated delta layers stay directional.
- Lower VRAM footprint on load: the frozen language backbone is quantized to NF4, while the vision encoder stays in BF16 precision.
What you can do
- Upgrade RAG and document search: extract exact sentences and clauses from contracts or knowledge bases tailored to a specific query.
- Pinpoint regions in images: locate specific visual areas in screenshots, scans, or photos based on a text question.
- Tune recall to fit your task: adjust the cutoff via the
--thresholdflag (defaulting to 0.4 for text and 0.3 for images) to pull narrower or broader context.
Example
hf download spock-oss/sel-qwen-9b --local-dir ./sel-qwen-9b
CUDA_VISIBLE_DEVICES=0 sel predict --weights ./sel-qwen-9b \
--text 'This agreement is governed by the laws of Oregon.' \
--query 'Which state governs the agreement?'Read more
DetailsBenchmarks: 77.6% Mean F1 (task-macro) on the Run09 test set (3,136 samples), 75.3% across a 26-task gallery, and 79.9% on additional dev sources.
Hardware and limits: requires a single NVIDIA GPU with BF16 support; maximum sequence length is 2,048 tokens (including the question and visual patches).
Training: 88.65M trainable parameters (LoRA + dense head), trained for 2 epochs on 43.09M input tokens.
Model family: 0.8B, 4B, and 27B parameter versions are also available in the release.










Comments