Drag-and-Drop LLMs
Generate LoRA weights in seconds without training
2 min readupdated
Drag-and-Drop LLMs (DnD) is a method from the authors of a NeurIPS 2025 paper that adapts large language models to new tasks without traditional gradient-based training. Instead of running fine-tuning, the model takes a small batch of unlabeled prompts and maps them directly into a ready-to-use set of LoRA matrices (lightweight trainable adapters layered onto model weights). Under the hood, a lightweight text encoder compresses the prompt batch into condition embeddings, while a cascaded hyper-convolutional decoder synthesizes adapter parameters for a target LLM (large language model) or VLM (vision-language model). It is built for developers and researchers who need to quickly specialize models like Qwen2.5 for reasoning, math, coding, or multimodal tasks.
Key features
- Training-free adaptation: generates working LoRA weights for a new task in seconds instead of running a full optimization pass.
- Up to 12,000x lower compute cost: according to the authors, computational overhead is drastically lower than full fine-tuning.
- Up to 30% quality gains: outperforms top classically trained LoRAs on average across unseen benchmarks in logic, math, coding, and multimodality.
- Cross-domain generalization: once trained on prompt-checkpoint pairs, the system synthesizes adapters without seeing labeled answers or the target dataset.
What you can do
- Spin up a task-specific LoRA fast: generate an adapter for Qwen2.5-0.5B/1.5B/7B-Instruct or Qwen2.5-VL-3B-Instruct from just a handful of sample prompts.
- Reproduce ARC-c experiments: run a ready-made pipeline for common sense reasoning tasks using the authors' released checkpoints.
- Train your own weight generator: collect custom LoRA checkpoints via LLaMA-Factory, compute layer importance weights, and train DnD for your own domain.
Example
git clone [https://github.com/jerryliang24/Drag-and-Drop-LLMs.git](https://github.com/jerryliang24/Drag-and-Drop-LLMs.git)
cd Drag-and-Drop-LLMs
bash install.sh
hf download Qwen/Qwen2.5-0.5B-Instruct --local-dir models/Qwen/Qwen2.5-0.5B-Instruct
bash scripts/common_sense_reasoning/ARC-c/training_and_generation.sh
Read more
DetailsPaper accepted at NeurIPS 2025 (arXiv: 2506.16406); released weights and logs are available in the Jerrylz/DnD-checkpoints-and-logs dataset.
Supported base models and encoders listed in the docs: Qwen/Qwen2.5-0.5/1.5/7B-Instruct, Qwen/Qwen2.5-VL-3B-Instruct, sentence-transformers/all-MiniLM-L12-v2, and google-t5/t5-base.
Training your own generator requires prepared dataset-to-checkpoint pairs and importance weight calculation via weighted MSE (the example config specifies up to 8 GPUs).










Comments