Charlie320/zils-mini-m15p
a compact fine-tune for Bittensor subnet 127
2 min readupdated
This model is a fine-tuned version of Qwen/Qwen3.5-4B (an open-weight language model with 4.54 billion parameters) built for the Zils d3-mini ecosystem within Bittensor subnet 127. It was created by averaging two rank-64 LoRA adapters (small add-on layers used to quickly adapt a base model) trained with different seeds on specialized datasets. The model retains vision capabilities from its parent configuration, was trained in BF16 (a reduced-precision floating-point format), and is geared toward specialized decision-making and text tasks.
Key features
- Built on the modern Qwen/Qwen3.5-4B model while preserving the vision tower from the parent model.
- Trained on a 61,091-row dataset containing exam-style problems and structured solutions.
- Created by averaging the weights of two LoRA adapters with equal weighting.
- Uses soft training targets to balance model responses with base probabilities.
What you can do
- Deploy the model as a decision-making component within the Bittensor subnet 127 ecosystem.
- Run local inference of this 4.54-billion-parameter model in BF16 for text-and-vision tasks.
- Evaluate how the model handles exam-style formats and classification tasks.
- Test function calling capabilities enabled by training on the glaive-function-calling-v2 dataset.
Example
The model does not include bundled inference scripts, so you can load the weights the standard way through the Transformers library using the base Qwen3.5 architecture.
Read more
DetailsBase model: Qwen/Qwen3.5-4B and joamCriff123/zils-mini-m1115
Parameter count: 4.54 billion
Weight format: BF16
Training method: averaging of two LoRAs (rank 64) at a 5e-5 learning rate










Comments