Install a model with LoRAs in one command
Find a model (language, image and video, robotics or anything else), add the LoRAs made for it and pick a GPU. One command below installs it all.
1. Model
Ready ComfyUI builds
For these families: Comfy-Org's official files at the right precision.
Chosen model: Team 9 College Data SLM
Pick another model3. LoRAs
No LoRAs for this model on the site yet.
4. GPU and precision
Precision
Fewer bits per weight means less memory and faster loading, at a small cost in quality. The number on each button is the GPU memory it needs.
Your command
Language model: runs on vLLM with an OpenAI-style API; every chosen LoRA is attached to the server.
Needs ≈ 0.6 GB of GPU memory, you have 24 GB. It fits.
#!/usr/bin/env bash
# Team 9 College Data SLM
# NVIDIA driver: CUDA 13 needs 580+. If older or missing, the current nvidia-open is installed (keep yours: KEEP_DRIVER=1)
DRV=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader 2>/dev/null | head -1 | cut -d. -f1)
case "$DRV" in ""|*[!0-9]*) DRV=0 ;; esac
if [ "$DRV" -lt 580 ] && [ -z "${KEEP_DRIVER:-}" ]; then
. /etc/os-release && \
curl -fsSLO "https://developer.download.nvidia.com/compute/cuda/repos/ubuntu${VERSION_ID//./}/x86_64/cuda-keyring_1.1-1_all.deb" && \
sudo dpkg -i cuda-keyring_1.1-1_all.deb && rm -f cuda-keyring_1.1-1_all.deb && \
sudo apt-get update && \
sudo DEBIAN_FRONTEND=noninteractive apt-get install -y nvidia-open || \
{ echo "Could not install the NVIDIA driver: see the error above. To keep the current one, run with KEEP_DRIVER=1."; exit 1; }
echo "NVIDIA driver updated. Reboot the machine (sudo reboot) and run this same script again."
exit 0
fi
curl -LsSf https://astral.sh/uv/install.sh | sh
source "$HOME/.local/bin/env"
uv venv ~/vllm --python 3.12 --allow-existing && source ~/vllm/bin/activate
uv pip install vllm
vllm serve sree02200/team9-college-data-slm --max-model-len 8192 --quantization fp8The server listens on port 8000 and speaks the OpenAI API: http://localhost:8000/v1 on the machine. From your computer: ssh -L 8000:localhost:8000 user@machine-IP.