Script2Play-4B
a model for playing games from screen frames
1 min read
Script2Play-4B is a vision-language-action (VLA) policy built on Qwen3.5-4B-Base, trained to play video games directly from raw screen capture. It takes a single frame and a text prompt as input, outputting a sequence of keyboard and mouse actions for the next 200 milliseconds. Trained via behavior cloning on Minecraft and Roblox demonstrations, it is well-suited for researchers and developers building interactive agents and autonomous game-playing systems.
Key features
- Built on the Qwen3.5-4B-Base architecture
- Trained on 150.3 hours of verified demonstrations (Minecraft and Roblox)
- Designed to generate low-level mouse and keyboard commands
- Runs via a standard OpenAI-compatible endpoint in vLLM
What you can do
- Run the model as a game-playing agent for Minecraft or Roblox via vLLM
- Integrate the model into custom test environments to evaluate autonomous gameplay
- Explore vision-language-action model capabilities in real-time control tasks
Example
Launching the model server with vLLM:
vllm serve PATH_TO_THIS_REPO --served-model-name script2play --trust-remote-code \
--max-model-len 8192 --max-num-batched-tokens 8192 --limit-mm-per-prompt '{"image":1,"video":0}' \
--attention-backend FLASHINFER --mm-encoder-attn-backend TORCH_SDPARead more
DetailsBase model: Qwen/Qwen3.5-4B-Base (approx. 4.54B parameters)
Training: 26.9h of Minecraft and 123.4h of Roblox (no human data or RL used)
Interface: OpenAI-compatible endpoint via vLLM 0.26
Output format: Mouse movement and key presses over a 200 ms window










Comments