z3-mini soup preview 2
a merge of three Qwen3.5-4B decision-making models
2 min readupdated
A daily preview checkpoint from the Zils network created via a model soup (uniformly averaging the weights of several trained models into one). Built on the 4.54B-parameter Qwen3.5-4B architecture, it merges the language block weights from three models trained by Zils miners for decision-selection tasks. Compared to the base d3-mini (z3-mini v1) release, this build delivers substantially higher probabilistic accuracy on private test sets. It fits developers looking for a compact model for text-based classification and decision-making via a d3-mini-compatible API.
Key features
- Uniformly averages the
language_model.*weights of three fine-tuned models (zils-mini-hm4,zils-mini-decision-t2avg, andzils-mini-m1113b) in fp32 and saves the result in bf16. - Keeps the vision tower, output head, tokenizer, and prompt format unchanged from
d3-mini. - Bakes a calibrated temperature of 1.36 into
model.json, tuned by the network on a held-out validation set. - Fully compatible with the
d3-mini v3.1.0launch format and/v1/systemoneAPI.
What you can do
- Use it as a drop-in replacement for
d3-miniin existing pipelines built aroundd3_runtime.pyand the/v1/systemoneendpoint. - Deploy it in automated text scenario scoring and decision-making pipelines where probability calibration (Brier skill) matters.
- Benchmark its performance against single models (
torchcast-decision-4b,Matilda-Decision-v1-Mini) on your own text datasets.
Example
Run the model through the standard d3-mini v3.1.0 runtime (d3_runtime.py and d3_engine.py): point the launch config to this repository and send text decision-making requests in the d3-mini prompt format to the /v1/systemone endpoint.
Read more
DetailsZils private test set (25,008 questions, Brier skill 0–100): 58.1 vs. 46.9 for
d3-mini (z3-mini v1).November 16, 2026 round: 56.8 vs. 48.3 for
torchcast-decision-4b, 47.6 for Matilda-Decision-v1-Mini, and 43.9 for pplx-decider-flash-v1.2.Limitations: this is a preview build that has not gone through final Zils release gating; adapters from
z3-mini v1 may not work; only text-based decisions were evaluated; training data from the ingredient models may overlap with public benchmarks.License: Apache-2.0.










Comments