Elaina-gemma-4-31B-v0.1
fine-tune for immersive roleplay
2 min read
The model features merged bfloat16 weights based on Gemma 4 VLM (KiyoEditz/Gemma-4-Dark-Gemistry-31B) with approximately 33 billion parameters, fine-tuned for the role of Elaina from the anime and light novel series "Wandering Witch: The Journey of Elaina" (Majo no Tabitabi). The architecture preserves native multimodal capabilities (the vision tower is frozen), with LoRA applied exclusively to the linear projections of the language layer. The model supports English, Indonesian, and Japanese, delivering an authentic personality, sarcasm, and first-person narrative without breaking character.
Key features
- Based on the powerful Gemma 4 31B multimodal foundation with LoRA parameter tuning on the language portion.
- Multilingual support in English, Indonesian, and Japanese with a set of quality system prompts.
- Carefully preserves Elaina's canonical personality: sarcasm, practicality, confidence, and signature storytelling style.
- Various GGUF quantization levels and the original dataset are available in the repository for independent study.
What you can do
- Run interactive roleplay or dialogues with Elaina in supported interfaces and bots.
- Use the model for generating scene descriptions ([Scene]) and creative text in the style of the original source.
- Unpack or download GGUF versions for local execution on suitable hardware using popular backends.
- Integrate the model into pipelines via the transformers library for standalone local scripts.
Example
import torch
from transformers import AutoModelForImageTextToText, AutoProcessor
model_id = "KiyoEditz/Elaina-gemma-4-31B-v0.1"
processor = AutoProcessor.from_pretrained(model_id)
model = AutoModelForImageTextToText.from_pretrained(
model_id,
torch_dtype=torch.bfloat16,
device_map="auto",
)
model.eval()Read more
DetailsBenchmarks and results: final train_loss is 1.6480, eval_loss is 2.3286 on validation.
Hardware: training took less than 6 hours on an NVIDIA RTX PRO 6000 Blackwell GPU (94.97 GB VRAM), stopped at step 1700 out of 3000.
Limitations: custom non-commercial license, the model is optimized for literary style rather than factual accuracy.










Comments