skillforge-skiller-0.5B
a compact language model that runs right in your browser
2 min read
This fine-tuned version of the compact Qwen2.5-0.5B-Instruct base model is optimized for turning raw source material into finished skill documents. It was trained using LoRA (a lightweight adapter on top of the base model) on material-to-skill pairs tailored to a specific system prompt. Quantized to the q4f16_1 format via mlc-llm, the model runs directly in the browser through WebLLM with no remote servers needed. It is a great fit for generating short, structured documents locally on your device.
Key features
- Base model: Qwen2.5-0.5B-Instruct with an unchanged architecture.
- Training: LoRA fine-tune (r=16) on training pairs matched to a strict document format.
- Format: MLC q4f16_1 (8 shards, roughly 278 MB total).
- Runtime: runs locally in the browser via WebLLM using WebGPU.
What you can do
- Plug the model into a WebLLM-powered web app to generate skill documents locally in the browser.
- Use it as a free, private on-device option without sending data to a server.
- Generate short, cleanly structured skills and text assets in resource-constrained environments.
Example
import { CreateMLCEngine } from "@mlc-ai/web-llm";
const engine = await CreateMLCEngine("skillforge-skiller-0.5B", {
appConfig: {
model_list: [
{
model_id: "skillforge-skiller-0.5B",
model: "[https://huggingface.co/Ciao22/skillforge-skiller-0.5B](https://huggingface.co/Ciao22/skillforge-skiller-0.5B)",
model_lib: "[https://raw.githubusercontent.com/mlc-ai/binary-mlc-llm-libs/main/web-llm-models/v0_2_87/base/Qwen2-0.5B-Instruct-q4f16_1_cs1k-webgpu.wasm](https://raw.githubusercontent.com/mlc-ai/binary-mlc-llm-libs/main/web-llm-models/v0_2_87/base/Qwen2-0.5B-Instruct-q4f16_1_cs1k-webgpu.wasm)",
vram_required_MB: 944.62,
low_resource_required: true,
overrides: { context_window_size: 4096 },
},
],
},
});Read more
DetailsVRAM requirements: around 944.62 MB.
Limitations: trained on a small set of 12 handcrafted pairs and sitting at just 0.5B parameters, the model works best on short tasks and is not a replacement for large flagship models.










Comments