Dataset · vidore
ColPali training set for document retrieval
vidore/colpali_train_set
127K query-image pairs for training visual document retrieval.
What's inside
This is the ColPali training set: 127,460 query-image pairs. 63% are taken from open academic datasets, 37% are synthetic PDF pages from web crawling with pseudo-questions from Claude-3 Sonnet. The set is entirely English; modalities are images and text.
What you can do with it
- Train ColPali or LoRA for visual document retrieval
- Fine-tune a document question answering model on page images
- Test zero-shot transfer to non-English documents
- Tasks
- Document question answering, Visual document retrieval
- Size
- 100K–1M rows
- Downloads this month
- 5.3K
- Likes
- 93
Models trained on it
- vidore/colqwen2-v1.0-hfVisual document retrieval 26.7K
- vidore/colpali-v1.2Visual document retrieval 14.3K
- vidore/colpali-v1.3Visual document retrieval 11.6K
- athrael-soju/colqwen3.5-4.5B-v3Visual document retrieval 3.4K
- vidore/colpali-v1.3-merged 2K
- lightonai/LightOn-rerank-PW-2BImage text → text 2K
- lightonai/LightOn-rerank-LW-2BImage text → text 1.9K
- lightonai/LightOn-rerank-PW-4BImage text → text 1.9K
How to load it
from datasets import load_dataset
ds = load_dataset("vidore/colpali_train_set")