Supermix v99 Cognitive Fabric
a Drosophila connectome micro-LLM with verification
2 min readupdated
This experimental release from Kai9987kai pairs ultra-lightweight language models (just 36.6M total parameters, with 9.13M active per token) with the Cognitive Fabric system for strict output verification. Its architecture combines MoE (Mixture of Experts) with organizational principles from the fruit fly (Drosophila) nervous system connectome, including neurogenesis, homeostasis, and prediction-error modulation. Unlike standard mini-models, the system doesn't rely solely on generation: a built-in verifier checks logic, math, and code using a restricted Python AST interpreter and exact solvers. It's a great fit for researchers exploring compact neuro-symbolic systems and enthusiasts running models locally without a GPU.
Key features
- Ultra-compact footprint: 36,599,047 total parameters (9,132,151 active per token) and a 9,415-token vocabulary — runs reliably on a standard CPU.
- Bio-inspired architecture: the primary
v96checkpoint uses two-somatic compartments and homeostasis, while the experimentalv98andv99builds addcns_predictive_error, a Hebbian trace, and cycle-entropy halting. - Deterministic verification (SCF): a Python AST micro-interpreter (capped at 500 operations, without unsafe
eval/exec), exact solvers, and an offline connectome atlas push hybrid accuracy to 100% (41/41) on task suites. - Ready-to-use local server: ships with
supermix_chat_server.pyfeaturing SSE streaming, MTP speculative decoding, telemetry, and verification certificate displays.
What you can do
- Spin up a local web chat on your CPU to compare the baseline
v96checkpoint against the experimentalv99in real time while trackingPredErr normandHebbian gainmetrics. - Run the
scf verifymodule via CLI to deterministically check small Python expressions and algorithmic tasks without the risk of arbitrary code execution. - Experiment with orchestrating six Supermix model families (
ChampionNet,CognitiveLeap,QwenLoRA,OmniCollective,MiMoMix,NexusMind) in a unified pipeline.
Example
pip install torch numpy flask huggingface_hub
huggingface-cli download Kai9987kai/supermix-v99-cognitive-fabric --local-dir .
python example_usage.py
PYTHONPATH=source python -m scf verify "nums = [10, 12, 4]\nr = nums[1] + nums[2] Final r?"
python source/supermix_chat_server.py --model v96_physio_neurogenesis=weights/v96_physio_neurogenesis.selected.pt --port 8780
Read more
DetailsBenchmarks (pure model / SCF hybrid):
v96 scores 35/41 (0.854) on seed=82, 72/82 (0.878) on seed=83, and 41/41 (1.000) in hybrid mode; v99 achieves the lowest Dev Loss (0.026452) but trails v96 on pure tasks (33/41 and 67/82), keeping it in experimental status.Hardware: tested on Windows-11 without a GPU (PyTorch 2.11.0+cpu,
cuda_available=False); CUDA execution paths have not been verified.Limitations: the SCF framework is disabled by default (
SCF_ENABLED=False), and unverified model outputs are flagged as advisory only (answer_authority=False).









Comments