Skip to content

Install a model with LoRAs in one command

Find a model (language, image and video, robotics or anything else), add the LoRAs made for it and pick a GPU. One command below installs it all.

1. Model

Ready ComfyUI builds

For these families: Comfy-Org's official files at the right precision.

3. LoRAs

No LoRAs for this model on the site yet.

4. GPU and precision

Precision

Fewer bits per weight means less memory and faster loading, at a small cost in quality. The number on each button is the GPU memory it needs.

Your command

Language model: runs on vLLM with an OpenAI-style API; every chosen LoRA is attached to the server.

Needs ≈ 0.9 GB of GPU memory, you have 24 GB. It fits.

A30 on Massed Compute fits: $0.26 an hour with the coupon.Open Massed Compute
#!/usr/bin/env bash
# xlmr-hate-speech-sv
# NVIDIA driver: CUDA 13 needs 580+. If older or missing, the current nvidia-open is installed (keep yours: KEEP_DRIVER=1)
DRV=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader 2>/dev/null | head -1 | cut -d. -f1)
case "$DRV" in ""|*[!0-9]*) DRV=0 ;; esac
if [ "$DRV" -lt 580 ] && [ -z "${KEEP_DRIVER:-}" ]; then
  . /etc/os-release && \
  curl -fsSLO "https://developer.download.nvidia.com/compute/cuda/repos/ubuntu${VERSION_ID//./}/x86_64/cuda-keyring_1.1-1_all.deb" && \
  sudo dpkg -i cuda-keyring_1.1-1_all.deb && rm -f cuda-keyring_1.1-1_all.deb && \
  sudo apt-get update && \
  sudo DEBIAN_FRONTEND=noninteractive apt-get install -y nvidia-open || \
  { echo "Could not install the NVIDIA driver: see the error above. To keep the current one, run with KEEP_DRIVER=1."; exit 1; }
  echo "NVIDIA driver updated. Reboot the machine (sudo reboot) and run this same script again."
  exit 0
fi
curl -LsSf https://astral.sh/uv/install.sh | sh
source "$HOME/.local/bin/env"
uv venv ~/vllm --python 3.12 --allow-existing && source ~/vllm/bin/activate
uv pip install vllm
vllm serve TheArbite/xlmr-hate-speech-sv --max-model-len 8192 --quantization fp8

The server listens on port 8000 and speaks the OpenAI API: http://localhost:8000/v1 on the machine. From your computer: ssh -L 8000:localhost:8000 user@machine-IP.