Install a model with LoRAs in one command
Find a model (language, image and video, robotics or anything else), add the LoRAs made for it and pick a GPU. One command below installs it all.
1. Model
Ready ComfyUI builds
For these families: Comfy-Org's official files at the right precision.
3. LoRAs
Picked: 1Tick the ones you want, up to 12.
4. GPU and precision
Precision
Fewer bits per weight means less memory and faster loading, at a small cost in quality. The number on each button is the GPU memory it needs.
Your command
Language model: runs on vLLM with an OpenAI-style API; every chosen LoRA is attached to the server.
Needs ≈ 5.5 GB of GPU memory, you have 24 GB. It fits.
The script starts with token lines: paste yours between the quotes.
Hugging Face: one of the models is gated; accept its terms on its page and create a token at huggingface.co/settings/tokens.
#!/usr/bin/env bash
# Qwen3-4B-Instruct-2507-unsloth-bnb-4bit
# ===== Tokens: paste yours between the quotes =====
export HF_TOKEN="" # huggingface.co/settings/tokens, for gated models
# ==========================================
# NVIDIA driver: CUDA 13 needs 580+. If older or missing, the current nvidia-open is installed (keep yours: KEEP_DRIVER=1)
DRV=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader 2>/dev/null | head -1 | cut -d. -f1)
case "$DRV" in ""|*[!0-9]*) DRV=0 ;; esac
if [ "$DRV" -lt 580 ] && [ -z "${KEEP_DRIVER:-}" ]; then
. /etc/os-release && \
curl -fsSLO "https://developer.download.nvidia.com/compute/cuda/repos/ubuntu${VERSION_ID//./}/x86_64/cuda-keyring_1.1-1_all.deb" && \
sudo dpkg -i cuda-keyring_1.1-1_all.deb && rm -f cuda-keyring_1.1-1_all.deb && \
sudo apt-get update && \
sudo DEBIAN_FRONTEND=noninteractive apt-get install -y nvidia-open || \
{ echo "Could not install the NVIDIA driver: see the error above. To keep the current one, run with KEEP_DRIVER=1."; exit 1; }
echo "NVIDIA driver updated. Reboot the machine (sudo reboot) and run this same script again."
exit 0
fi
curl -LsSf https://astral.sh/uv/install.sh | sh
source "$HOME/.local/bin/env"
uv venv ~/vllm --python 3.12 --allow-existing && source ~/vllm/bin/activate
uv pip install vllm
vllm serve unsloth/Qwen3-4B-Instruct-2507-unsloth-bnb-4bit --max-model-len 8192 --quantization fp8 --enable-lora --max-loras 1 --max-lora-rank 64 --lora-modules Zain9989--pii-masker-qwen3-4b-lora=Zain9989/pii-masker-qwen3-4b-loraThe server listens on port 8000 and speaks the OpenAI API: http://localhost:8000/v1 on the machine. From your computer: ssh -L 8000:localhost:8000 user@machine-IP.