Invaria Tiny Aya Steering
activation steering vector for tiny-aya-global
2 min readupdated
This is a research steering vector (a direction in a model's activation space) extracted using the SafeTune method for the CohereLabs/tiny-aya-global base language model by balacode. Rather than being a standalone LLM, checkpoint, or LoRA adapter, it is a 2048-element tensor added to the outputs of all 36 decoder layers at a fixed strength of 0.1. Unlike standard fine-tuning, this approach intervenes in generation without modifying the model's weights. The artifact is useful for AI safety researchers and developers exploring model behavior control via activations.
Key features
- Extracted with the SafeTune method from 30 calibration prompts at layer 18 of the model.
- Consists of a 2048-element vector applied additively to all 36 decoder outputs.
- Used alongside a specific revision of
CohereLabs/tiny-aya-global(af89d219b53ed9b13b8a4645f9c8028973510324) and the Invaria/SafeTune toolkit. - Ships with manifest and status files required to verify the artifact at runtime.
What you can do
- Run side-by-side chat comparisons between the base
tiny-aya-globalmodel and the steered version using theinvariaCLI tool. - Test activation intervention mechanics (attaching and cleanly removing 36 hooks, preserving original parameters at zero strength) in interpretability experiments.
- Reproduce pilot benchmarks on the companion
balacode/invaria-paired-safetydataset to analyze how the vector affects model responses.
Example
hf download balacode/invaria-tiny-aya-steering --local-dir artifacts/downloaded-steering
invaria chat --direction artifacts/downloaded-steering/direction.pt --strength 0.1 --compareRead more
DetailsPilot evaluation metrics: on a held-out benign split, the success rate reached 16/20 at strength 0.1 versus 14/20 for the base model (95% confidence interval for the delta: [0.00, 0.20]); on validation, it scored 7/10 in both cases and 6/10 at strength 0.3.
Limitations: safety gains and independent human verification have not been confirmed; outputs still exhibit unintended language switching, repetition, and inaccurate advice.
Requirements and compatibility: supports Python 3.12 and CUDA/NF4; the repository cannot be loaded via
AutoModel.from_pretrained, and you must accept Cohere's license terms for the base model.









Comments