Wan2.1
State-of-the-art open video generation model lineup
2 min readupdated
Wan2.1 is a comprehensive and powerful open video generation model lineup from Wan-Team that sets new standards in content synthesis. The repository features the T2V-1.3B (Text-to-Video) version, built on the Flow Matching architecture (a modification of diffusion models) and capable of running on consumer video cards. The model outperforms many existing open and commercial alternatives, supporting high-quality video generation from text descriptions. It will become an excellent tool for creative teams, video makers, and researchers with limited computational resources.
Key features
- SOTA performance: Demonstrates better results than many open alternatives and commercial solutions.
- Consumer GPU support: The T2V-1.3B version requires only 8.19 GB of VRAM and runs on an RTX 4090.
- Text generation on video: The first video model that confidently generates text in Chinese and English.
- Efficient Wan-VAE: The proprietary 3D variational autoencoder encodes and decodes 1080P video of any length without losing temporal information.
What you can do
- Generate a 5-second video in 480P resolution from a text prompt using a Python script or Diffusers integration.
- Connect prompt expansion via Dashscope API or local Qwen models for detailed scene development.
- Run the Gradio interactive web interface locally to experiment with video generation.
Example
import torch
from diffusers import AutoencoderKLWan, WanPipeline
from diffusers.utils import export_to_video
model_id = "Wan-AI/Wan2.1-T2V-1.3B-Diffusers"
vae = AutoencoderKLWan.from_pretrained(model_id, subfolder="vae", torch_dtype=torch.float32)
pipe = WanPipeline.from_pretrained(model_id, vae=vae, torch_dtype=torch.bfloat16)
pipe.to("cuda")
output = pipe(
prompt="A cat walks on the grass, realistic",
height=480,
width=832,
num_frames=81,
guidance_scale=5.0
).frames[0]
export_to_video(output, "output.mp4", fps=15)
Read more
DetailsVRAM requirements: from 8.19 GB for the 1.3B version (on an RTX 4090, generation takes about 4 minutes without quantization).
Architecture: Diffusion Transformer (DiT) based on the Flow Matching framework with a T5 text encoder.
Features: it is recommended to use 480P resolution for the 1.3B model due to result stability.








Comments