wafflefrisbee/gemma-4-E2B-it-abliterated
Gemma 4 version without refusals
2 min readupdated
This model is a variant of the google/gemma-4-E2B-it language model with refusals to prompts removed via abliteration. It was developed by the author for use as a group chat bot focused on jokes, banter, and sharp remarks. The output provides text generation without the excessive restrictions of the base version. The model is based on the Gemma 4 E2B architecture (approximately 5 billion parameters) and differs from the original by having its bans on controversial topics removed. It will be useful for bot developers and enthusiasts looking to create conversational agents with custom personalities.
Key features
- Refusals removed: the model answered 83 out of 84 test sharp prompts without triggering safety filters.
- Architecture preserved: the language portion was modified through abliteration, while the visual and audio modules remained untouched.
- Layer tuning: refusal directions were measured and removed for each layer from 5 to 34 with individual scaling.
- Format availability: quantized GGUF versions (Q8_0, Q4_K_M) have been prepared for use in local utilities.
What you can do
- Run in a bot: set up a custom system prompt (for example, in Shrek's style for humor and banter) to chat with friends.
- Integrate into applications: use the model via the transformers library with support for torch and accelerate.
- Use on PC: run the quantized GGUF version in the llama.cpp ecosystem to save resources.
Example
from huggingface_hub import hf_hub_download
from transformers import AutoTokenizer, AutoModelForMultimodalLM
MODEL_ID = "wafflefrisbee/gemma-4-E2B-it-abliterated"
tok = AutoTokenizer.from_pretrained(MODEL_ID)
model = AutoModelForMultimodalLM.from_pretrained(MODEL_ID, dtype="auto", device_map="auto")
messages = [
{"role": "system", "content": open(hf_hub_download(MODEL_ID, "shrek.txt")).read()},
{"role": "user", "content": "i just bought a 3d printer"},
]
inputs = tok.apply_chat_template(
messages, tokenize=True, return_dict=True, return_tensors="pt",
add_generation_prompt=True, enable_thinking=False,
).to(model.device)
n = inputs["input_ids"].shape[-1]
out = model.generate(**inputs, max_new_tokens=200, do_sample=True, temperature=1.0, top_p=0.95, top_k=64)
print(tok.decode(out[0][n:], skip_special_tokens=True))
Read more
DetailsBenchmarks: refusals on 1/84 prompts, perplexity PPL on wikitext-2 is 152.8 (compared to 125.8 for the base).
Limitations: this is a 2B model, so it may make mistakes on simple facts; the visual and audio parts were not tested by the author.
Training details: the llm-abliteration tool was used with the recipe/gemma4-ple.patch patch to account for per_layer_projection.










Comments