LifeMate V7 Weights
LoRA adapters and soup builds based on Qwen3.5-4B
2 min read
Creator Nhat42 has bundled a set of LoRA adapters (lightweight fine-tuning add-ons), merged LoRA soup builds, and evaluation logs for the LifeMate V7 system into a single repository. It is built on the Qwen/Qwen3.5-4B language model, trained on synthetic data to generate responses and tool calls. The project's standout feature is its exact rank concatenation method (exact_rank_concat), which merges up to five different adapters into one without precision loss—even on a standard CPU. This release is useful for developers experimenting with model weight merging and building compact LLM agents under 5B parameters.
Key features
- Pre-merged g_all5 build: combines five specialized adapters (F1–F5) with equal weights, boosting the final score on unseen validation to 73.89 compared to 67.54 for the baseline.
- CPU-only merging without a GPU: the repository documents a reproducible workflow for merging individual LoRA modules into a single file with SHA256 checksum verification.
- Task-specialized adapters: separate modules in the
adapters/folder were fine-tuned for distinct subtasks—compute, date handling, logic branching, and DPO alignment. - Transparent benchmarks: detailed evaluation reports (
summary.json,details.jsonl) are included for 17 configurations across theval_seenandval_unseensplits.
What you can do
- Build a compact
Qwen3.5-4B-based model for local agents that need to call external functions and APIs. - Use the ready-made adapters from the
adapters/directory to experiment with model merging and compare different fine-tuning strategies.
Example
pip install huggingface_hub
export HF_TOKEN=hf_xxx
huggingface-cli download Nhat42/lifemate-v7-weights \
--include "submission/g_all5/*" \
--local-dir outputs/v7/hf_weights
Read more
DetailsBase model: Qwen/Qwen3.5-4B (final merged build under 5B parameters)
Best result (g_all5): final_score 73.89 (hash_match 82.33%) on val_unseen (232 samples) and 85.46 (92.22%) on val_seen (257 samples)
LoRA parameters: r=32, lora_alpha=64 for single adapters (232.6 MB each) and r=160, lora_alpha=320 for g_all5 (1162.6 MB)
Note: the repository is marked as Private on the model card; an access token is provided for CLI downloads










Comments