youdotcom/reflex-search - a compact tool for search filtering on CPU
2 min readupdated
The youdotcom/reflex-search model is a compact solution for search filtering and source ranking tasks, running entirely on the CPU. It is built upon the text component of the google/embeddinggemma-2 model with 0.27B parameters, stripping away the visual and audio modules to conserve resources. The entire checkpoint takes up about 517 MB on disk and requires between 196 and 315 MB of RAM (no VRAM needed). The model is designed for integration into search MCP (Model Context Protocol) tools, where it evaluates queries, ranks search results, and filters out irrelevant data before querying main APIs.
Key features
- CPU-friendly: Runs on standard processors with minimal memory consumption thanks to the removal of extra layers and quantization.
- Two-level gating: The first level filters subqueries and weeds out hallucinations, while the second level ranks search results and web hits.
- Adapted heads: Utilizes ranking LoRA adapters and specialized projection heads for precise relevance scoring.
- MCP integration: Developed specifically to work within the ecosystem of search and text MCP tools (/mcp/reflex).
What you can do
- Search optimization: Embed it into a local search bot or agent to filter out redundant queries before sending them to the search engine.
- Result ranking: Use it to evaluate the relevance of web pages, documents, and PDF excerpts for a specific task.
- Save API calls: Apply preflight filtering to cut off irrelevant or excessive queries before using up quotas.
Example
The model is used via specialized heads and configurations to evaluate the relevance of text passages and rank search results within the MCP protocol.
Read more
DetailsBenchmarks: Choice accuracy 49.2%, Noul 77.5%, Score RPS 0.1554.
Hardware requirements: runs on CPU, 196 MB to 315 MB RSS.
License: Apache-2.0 for base weights and new adapters.










Comments