VultronRetrieverPrime-Qwen3.5-8B-v2
Flagship visual document retriever
2 min readupdated
The model solves the task of visual search across documents, scans, tables, charts, and reports in six languages simultaneously (English, French, German, Spanish, Italian, and Portuguese). Built on the Qwen/Qwen3.5-9B hybrid architecture (8.4 billion parameters), it uses a late-interaction approach (ColBERT-style), scoring pages by their rendered images using 4096-dimensional multi-vector embeddings. Unlike simple text embeddings, this approach enables precise matching of queries with tables, charts, and layout elements. The model is useful for multimodal RAG system developers who need maximum search accuracy over complex documents.
Key features
- ViDoRe V3: 67.46 average nDCG@10 across 8 public tasks, outperforming many alternatives.
- Bidirectional attention: all 8 full-attention layers operate bidirectionally for better context understanding.
- 4096-dim multi-vectors: detailed token-level representation (up to 1792 visual tokens per page).
- Efficiency: requires about 17 GB of VRAM in bf16 and runs on a single GPU.
What you can do
- Multimodal RAG: integrate into a search system or chatbot for accurate answers retrieval from PDF scans, reports, and slides.
- Table and diagram analysis: extract information from pages with complex layouts, charts, and tabular data.
- Multilingual search: index documents in six European languages without quality loss.
- Integration via vLLM: deploy in production using a pooling runner and the MaxSim pipeline.
Example
Model initialization and encoding queries with images using the Sentence Transformers library:
from sentence_transformers import MultiVectorEncoder
model = MultiVectorEncoder("vultr/VultronRetrieverPrime-Qwen3.5-8B-v2")
queries = [
"What is the variable represented on the y-axis of the graph?",
"Total outlay is maximum in which year?",
]
images = [
"[https://huggingface.co/datasets/sentence-transformers/example-documents/resolve/main/doc1.jpg](https://huggingface.co/datasets/sentence-transformers/example-documents/resolve/main/doc1.jpg)",
"[https://huggingface.co/datasets/sentence-transformers/example-documents/resolve/main/doc2.jpg](https://huggingface.co/datasets/sentence-transformers/example-documents/resolve/main/doc2.jpg)",
]
query_embeddings = model.encode_query(queries)
image_embeddings = model.encode_document(images)
scores = model.similarity(query_embeddings, image_embeddings)
print(scores)
Read more
Details• Benchmarks: ViDoRe V3 (67.46 nDCG@10), MTEB V1 (93.35), V2 (72.91).
• Requirements: about 17 GB VRAM (bf16), transformers library support >= 5.2.0.
• Limitations: retriever only, requires a separate reader/LLM for response generation; supports exactly 6 languages.










Comments