LumenSearch Reranker v2
A New Cross-Encoder for Search Systems
2 min read
The LumenSearch Reranker v2 model is the second-generation cross-encoder (a model for evaluating query-document pair relevance) created for the LumenSearch search stack. It recalculates the scores of top candidates retrieved during the initial search phase, helping to rank results more accurately. Built on the lumen-ai/lumen-encoder-base-110m encoder architecture and trained on English-language search queries, it features improved quality metrics compared to the first version and will be useful for developers of search systems and information retrieval systems.
Key features
- Built on the
lumen-ai/lumen-encoder-base-110mmodel using the sentence-transformers library. - Improved quality metrics on the fixed
heldout_v2dataset compared to v1. - Designed for evaluating short web fragments up to 512 tokens in size.
- Outputs a relevance score for re-ordering the list of candidates.
What you can do
- Integrate the model into your search pipeline to improve result ranking during the second stage.
- Use it to recalculate document relevance for English-language search queries.
- Apply it in custom search and information retrieval systems (RAG pipelines).
Example
The model is used to evaluate query-document pairs and outputs a numerical relevance score. For details on running it via the sentence-transformers library, see the repository documentation.
Read more
DetailsBenchmarks on heldout_v2: nDCG@10 is 0.731 (+0.029 gain), MRR@10 is 0.688 (+0.027 gain), Recall@50 is 0.874 (+0.025 gain), MAP@10 is 0.641 (+0.034 gain).
Limitations: not trained for summarizing long documents, answering table-based questions, or multilingual search.
Not a standalone search model and does not have its own document index.










Comments