WeightSeek-Format22-0.8B
A specialized LLM for JSON tasks
2 min readupdated
WeightSeek-Format22-0.8B is a standalone 0.75-billion-parameter text model (LLM, language model) in FP16 format (half-precision computing), built for experimenting with precise instruction following. Its key advantage over the base version is the ability to consistently output a valid JSON object that parsers can read without errors. The model is built upon the work of Rikiya Takehi and colleagues for Qwen3.5-0.8B using weight modifications. It is useful for developers who need a compact local model for structured data output.
Key features
- Based on the Qwen3.5-0.8B architecture with weight-space programming modifications.
- Weighs about 1.50 GB in a single safetensors file containing all 752 million parameters.
- Improved instruction following: the model outputs clean JSON where the previous version failed.
- Works out of the box with the standard transformers library in environments like Colab or Kaggle on a single GPU.
What you can do
- Integrate the model into local data processing pipelines to generate JSON configuration files.
- Use it as a compact parser in projects where strict response syntax is critical.
- Conduct experiments with weight-space programming and precise text prompt adherence.
Example
import json
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer
repo = "efe-T/WeightSeek-Format22-0.8B"
tokenizer = AutoTokenizer.from_pretrained(repo)
model = AutoModelForCausalLM.from_pretrained(
repo, dtype=torch.float16, device_map="cuda", attn_implementation="eager"
).eval()
messages = [{
"role": "user",
"content": "One JSON object is needed for a config file. Set the property 'elmwood' to the string 'almondwood'.",
}]
prompt = tokenizer.apply_chat_template(
messages, tokenize=False, add_generation_prompt=True, enable_thinking=False
)
inputs = tokenizer(prompt, add_special_tokens=False, return_tensors="pt").to(model.device)
with torch.inference_mode():
output = model.generate(
**inputs, do_sample=False, max_new_tokens=None,
max_length=model.config.max_position_embeddings,
eos_token_id=[248044, 248046], pad_token_id=tokenizer.pad_token_id,
)
answer = tokenizer.decode(output[0, inputs.input_ids.shape[1]:], skip_special_tokens=True)
print(json.loads(answer)) # {'elmwood': 'almondwood'}
Read more
DetailsBenchmarks: on a test of 105 prompts, the model scored 50 points compared to 42 for the parent version (including 8 successful responses in Plain JSON format instead of 0).
Hardware requirements: runs on a standard GPU (such as Colab T4) thanks to FP16 and a size of 1.50 GB.
Limitations: JSON improvements are mostly observed in English (results remained at zero for Turkish prompts). Distributed under the Apache 2.0 license.










Comments