SalgrAI-Decider
mini model for choice selection and classification
2 min read
SalgrAI-Decider is an ultracompact 25-million parameter model that does not generate text, instead handling multi-class classification and choosing from 2 to 8 options. The model takes a situation, a question, and a list of options as input, outputting probabilities for each choice in a single forward pass. Its architecture is built on an 11-layer SalgrAI-v1.2 transformer featuring bidirectional attention and a special pointer head. This project will appeal to developers and researchers exploring compact routing models and Russian text classification.
Key features
- Ultracompact size (just 25M parameters, runs locally without heavy hardware).
- Bidirectional attention architecture instead of a generative language head.
- Fast probability output for a list of 2 to 8 options in a single pass.
- Core language base and training focused on Russian text.
What you can do
- Integrate it into your pipeline for fast user message routing and intent classification.
- Use it to classify dialog topics or determine when to trigger a refusal response.
- Experiment with probability calibration and the behavior of ultra-small decision-making models.
Example
import sys
from huggingface_hub import snapshot_download
path = snapshot_download("salgr/SalgrAI_Decider_1")
sys.path.insert(0, path)
from salgrai_decider import SalgrDecider
d = SalgrDecider.from_pretrained(path)
for r in d.decide("Как установить питон на компьютер?",
["программирование", "еда, здоровье и быт", "география и история"],
criteria="О чём этот диалог?"):
print(f"{r['prob']:.2f} {r['option']}")
Read more
DetailsBenchmarks: message type accuracy 0.98, dialog topic accuracy 0.89.
Hardware requirements: minimal thanks to the 25M parameter size.
Limitations: unreliable outside of trained tasks, not suitable for moderation or safety.
Training: 3 epochs on 81,534 automatically generated tasks.










Comments