Novalyte-v2-27B
Qwen3.8-based conversational model
2 min readupdated
The new Novalyte-v2-27B model is a full-size merged checkpoint built on the Qwen3.8-27B architecture. It is fine-tuned using SFT (supervised fine-tuning) for a specific identity and conversational style while maintaining the strong baseline capabilities in Chinese and English. Weights are provided in Safetensors format matching the original structure, so no extra LoRA adapters are required to run it. This option suits researchers and developers exploring how fine-tuning affects the behavior of large language models.
Key features
- Base model: Built on
Qwen3.8-27Bwith around 27.78 billion parameters inBF16format. - Training method: Fine-tuned via QLoRA using the
LLaMA-Factoryframework on a specialized identity dataset. - Open license: Distributed under the permissive
Apache-2.0license. - Transparent benchmarks: The authors honestly note that version two trails version one in metrics and publish the comparative results.
What you can do
- Local deployment: Run the model locally on suitable hardware to test conversational abilities and text generation.
- Pipeline integration: Use the weights as a ready starting point for your own language model fine-tuning experiments.
- Quality analysis: Review C-Eval, MMLU, and CMMLU benchmark results to evaluate score drops or gains after custom SFT.
Example
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer, BitsAndBytesConfig
model_id = "voblcn/Novalyte-v2-27B"
tok = AutoTokenizer.from_pretrained(model_id, trust_remote_code=True)
bnb = BitsAndBytesConfig(load_in_4bit=True, bnb_4bit_quant_type="nf4",
bnb_4bit_use_double_quant=True, bnb_4bit_compute_dtype=torch.bfloat16)
model = AutoModelForCausalLM.from_pretrained(model_id, trust_remote_code=True,
quantization_config=bnb, device_map="auto")
prompt = "<|im_start|>user\n你是谁?<|im_end|>\n<|im_start|>assistant\n"
ids = tok(prompt, return_tensors="pt").to(model.device)
out = model.generate(**ids, max_new_tokens=128, do_sample=False)
print(tok.decode(out[0][ids["input_ids"].shape[1]:], skip_special_tokens=True))Read more
Details• Weight format: Safetensors (18 shards, around 51.75 GiB of data).
• Hardware requirements: Full BF16 precision requires approximately 52 GiB VRAM/RAM, while 4-bit quantization is available for running on 24–32 GiB GPUs.
• Metrics: On a subset of 433 tests, the base model scores 74.8%, v1 scores 80.4%, and the current v2 scores 77.6%.
• Important note: The authors recommend using the previous v1 version for practical use due to better stability.










Comments