GAR-Lite-2B: A compact multimodal model for image region tasks
2 min readupdated
GAR-Lite-2B is an official standard checkpoint from the Grasp Any Region v2: Generalist Multimodal Region Experts at Scale project. Architecturally, it is built on the unmodified Qwen3.5-2B base model and trained via two-stage OPD (on-policy distillation). The model specializes in image-text-to-text multimodal tasks, enabling efficient processing of specific image regions and text descriptions. It is useful for developers and researchers who need a lightweight vision-language model with support for standard libraries like Transformers and vLLM.
Key features
- Built on the unmodified
Qwen3.5-2Barchitecture (Qwen3_5ForConditionalGeneration). - Trained via two-stage OPD (on-policy distillation) using two GAR-v2 teacher models.
- Fully compatible with the standard Hugging Face Transformers library without requiring custom code.
- Native support in the popular vLLM engine without additional plugins.
What you can do
- Run inference for detailed description or analysis of specific bounding boxes on images.
- Integrate the model into Python scripts using the standard processor and
AutoModelForImageTextToTextclass. - Use a standalone CLI script for quick testing of the model's multimodal capabilities using bounding box coordinates.
- Deploy the model on a vLLM-based inference server for efficient request processing.
Example
Running the model using the standard Hugging Face Transformers library:
import torch
from transformers import AutoModelForImageTextToText, AutoProcessor
processor = AutoProcessor.from_pretrained("laolida-w/GAR-Lite-2B")
model = AutoModelForImageTextToText.from_pretrained(
"laolida-w/GAR-Lite-2B",
torch_dtype=torch.bfloat16,
device_map="auto",
).eval()Read more
DetailsModel size: 2.72 billion parameters (2.72B).
Architecture: Distilled Qwen3_5ForConditionalGeneration.
Running features: Support for
torch.bfloat16 and automatic device mapping (device_map).









Comments