Install a model with LoRAs in one command
Find a model (language, image and video, robotics or anything else), add the LoRAs made for it and pick a GPU. One command below installs it all.
1. Model
Ready ComfyUI builds
For these families: Comfy-Org's official files at the right precision.
Chosen model: Qwen3.8-27B-Coder390-EXL3-3.85bpw
Pick another model3. LoRAs
No LoRAs for this model on the site yet.
4. GPU and precision
Precision
Fewer bits per weight means less memory and faster loading, at a small cost in quality. The number on each button is the GPU memory it needs.
Your command
Language model: runs on vLLM with an OpenAI-style API; every chosen LoRA is attached to the server.
Needs ≈ 8.6 GB of GPU memory, you have 24 GB. It fits.
#!/usr/bin/env bash
# Qwen3.8-27B-Coder390-EXL3-3.85bpw
# NVIDIA driver: CUDA 13 needs 580+. If older or missing, the current nvidia-open is installed (keep yours: KEEP_DRIVER=1)
DRV=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader 2>/dev/null | head -1 | cut -d. -f1)
case "$DRV" in ""|*[!0-9]*) DRV=0 ;; esac
if [ "$DRV" -lt 580 ] && [ -z "${KEEP_DRIVER:-}" ]; then
. /etc/os-release && \
curl -fsSLO "https://developer.download.nvidia.com/compute/cuda/repos/ubuntu${VERSION_ID//./}/x86_64/cuda-keyring_1.1-1_all.deb" && \
sudo dpkg -i cuda-keyring_1.1-1_all.deb && rm -f cuda-keyring_1.1-1_all.deb && \
sudo apt-get update && \
sudo DEBIAN_FRONTEND=noninteractive apt-get install -y nvidia-open || \
{ echo "Could not install the NVIDIA driver: see the error above. To keep the current one, run with KEEP_DRIVER=1."; exit 1; }
echo "NVIDIA driver updated. Reboot the machine (sudo reboot) and run this same script again."
exit 0
fi
curl -LsSf https://astral.sh/uv/install.sh | sh
source "$HOME/.local/bin/env"
uv venv ~/vllm --python 3.12 --allow-existing && source ~/vllm/bin/activate
uv pip install vllm
vllm serve JRamirez-UAB/Qwen3.8-27B-Coder390-EXL3-3.85bpw --max-model-len 8192 --quantization fp8The server listens on port 8000 and speaks the OpenAI API: http://localhost:8000/v1 on the machine. From your computer: ssh -L 8000:localhost:8000 user@machine-IP.