Lumi-Simy
A compact 4B agentic model with tool calling
3 min read
Lumi-Simy is a 3.97-billion-parameter language model by author joaohsim, fine-tuned to select external functions (tool calling), invoke multiple tools in parallel, build query chains with response reading, and decline tool calls when no suitable tool matches. It is built on the reasoning model Lumi-Think-4B, which originates from CEIA Lumi-4B and the hybrid NVIDIA Nemotron 3 Nano 4B architecture (combining Mamba-2, MLP, and attention mechanisms). Training was performed via LoRA SFT (fine-tuning a small set of additional weights with subsequent merging into the base model) while preserving the thinking mode and general skills in English and Portuguese. The model is conceived as a research and educational project for experimenting with agentic behavior on compact hybrid architectures.
Key features
- Notable growth in multi-step tool calling: in the BFCL test, accuracy in
multi_turn_basescenarios rose from 25.0 to 43.0, and inlive_parallel_multiplefrom 41.7 to 70.8 compared to the base Lumi-Think-4B. - Parallel calls and declining unnecessary functions: the model can query multiple APIs in a single step and respond correctly without tool calls when the task does not require them.
- Preservation of general knowledge: through the addition of self-distilled replay data during training, scores on general EN/PT tests remained at the level of the original Lumi-Think (average score 75.6 vs. 75.8).
- Integration with a tool router: for large API catalogs, the author recommends pre-selecting the top 32 functions via the
BAAI/bge-reranker-v2-m3cross-encoder — this cuts the prompt from ~21k to ~5k tokens and boosts accuracy.
What you can do
- Build a local AI agent for databases and dashboards: the model was tested on BI API and dashboard API scenarios (VAKRA benchmark) and can fetch data step-by-step from multiple sources.
- Connect to services via OpenAI-compatible API: deploy via
vLLMwithqwen3_coderandnano_v3parsers and use in chatbots where external functions need to be triggered in parallel (e.g., requesting weather or data for multiple objects at once). - Explore a reproducible fine-tuning pipeline: use the model card and weights as a reference for training compact Mamba hybrids on a single RTX 4090 class GPU (24 GB).
Example
hf download joaohsim/Lumi-Simy --local-dir lumi-simy
VLLM_USE_FLASHINFER_SAMPLER=0 vllm serve ./lumi-simy --trust-remote-code \
--mamba-ssm-cache-dtype float32 --enable-auto-tool-choice \
--tool-call-parser qwen3_coder \
--reasoning-parser-plugin "$PWD/lumi-simy/nano_v3_reasoning_parser.py" \
--reasoning-parser nano_v3 --default-chat-template-kwargs '{"enable_thinking": true}' \
--max-model-len 32768 --max-num-seqs 16
Read more
DetailsVAKRA (5 new domains): 32.7% (Capability 1) and 51.7% (Capability 2; 60.3% with the
bge-reranker-v2-m3 router vs. 16.5% for Lumi-Think-4B).BFCL v3: outperforms Qwen3-4B across all four multi-turn categories, but trails in single and parallel calls.
Hardware and training: fine-tuned and tested on a single NVIDIA RTX 4090 (24 GB), training context of 20,480 tokens, 4,329 examples.
Limitations: educational release for non-commercial and academic use (VAKRA CC BY-NC-SA 4.0 license); not tested on web browsing or coding agents; reasoning in tool tasks is conducted primarily in English.










Comments