Signal 2 Flash Next Gyro
GGUF
2 min readupdated
A new compact version of the Qwen3.8-Flash-Next model (file size 59.5 GB), optimized for agentic coding and high efficiency. Built by the AgentionAI team through self-distillation on successful coding sessions, the model integrates tuning directly into the weights without using external adapters. It generates 27% fewer redundant tokens and reduces total agent run time compared to the base version while maintaining accuracy on complex tasks. Ideal for developers, engineers, and anyone running local agents to automate programming on their own hardware.
Key features
- High efficiency: outperforms or matches larger alternatives in solving complex multi-step programming tasks.
- Less waiting: reduces agent session execution time by generating fewer tokens without sacrificing quality.
- Self-distillation: trained on the base model's own successful and verified coding sessions.
- Adapter-free: tuning is fully baked into the weights, running as a standard monolithic file.
What you can do
- Integrate into a local Docker container to automate software development and code writing.
- Run on a Mac or AMD Strix Halo / RTX 5090 GPUs with a long context up to 64k.
- Use in specialized llama.cpp forks for agents supporting MTP (Multi-Token Prediction) drafts.
Example
Running the model via Docker using the optimized GGUF file and MTP draft:
hf download agentionai/Signal-2-Flash-Next-Gyro-GGUF Signal-2-Flash-Next-Gyro-S-TQ1_0.gguf --local-dir ~/models
docker run --rm -it --device /dev/dri --group-add "$(getent group render | cut -d: -f3)" \
-v ~/models:/models -p 8080:8080 agentionai/agention-llama:server \
-m /models/Signal-2-Flash-Next-Gyro-S-TQ1_0.gguf -ngl 999 -fa on --jinja --ngram-on-disk \
-c 65536 -ctk q8_0 -ctv q8_0 --temp 0.6 --top-p 0.95 --top-k 20 --min-p 0.05
Read more
DetailsBenchmarks: 87.5% success rate on the agentic gate (compared to 92.8% for the 111 GB file).
Hardware requirements: from 32 GB VRAM (with reduced context) to 64 GB+ unified memory (Mac, Strix Halo) for a 64k context.
Limitations: the upstream version of llama.cpp does not yet support loading this file, a fork (such as agentionai/llama.cpp) is required.
Training details: trellis-coded quantization with Hadamard transform (QTIP).










Comments