Starlord-4B-v2.0-preview
Qwen-Based Decision Model
2 min read
The new Starlord-4B-v2.0-preview model is built on Qwen/Qwen3.5-4B (4.54 billion parameters) and functions as a decision model. Instead of generating text, it reads candidate logits from the original vocabulary and processes the state along with all questions in a single forward pass. The model supports a context length of up to 131,072 tokens and up to 512 choices per question. This development will benefit researchers and engineers working on logical option selection and benchmarks.
Key features
- Works without text generation by reading logits from the original vocabulary
- Supports context up to 131,072 tokens for joint queries
- Capable of handling up to 512 choices per single question
- Requires a compatible BF16 CUDA GPU (such as an NVIDIA H800) and FlashAttention
What you can do
- Run performance evaluations on the JevBench and Decision Index benchmarks
- Deploy the model as a local service for evaluating response options
- Use it in research pipelines for multiple-choice tasks
Example
export PYTHONPATH="$PWD/inference${PYTHONPATH:+:$PYTHONPATH}"
CUDA_VISIBLE_DEVICES=0 python -m decision_index pipeline \
--edition 0.3 \
--suite-dir /path/to/suite-0.3 \
--engine di_engine:DecisionIndexEngine \
--model . \
--option maximum_tokens=131072 \
--out decision-index-resultsRead more
DetailsBenchmarks: JevBench Public — 94.37% (218/231), Decision Index Public 0.3 — 78.91%
Hardware: 1 × NVIDIA H800 with BF16 and CUDA Graph support
Limitations: KV-cache disabled, token generation set to 0
Stack: PyTorch 2.10.0, Transformers 5.3.0, FlashAttention 2.8.3










Comments