FastFrames-L
Fast Video Generation by Apple
2 min readupdated
FastFrames-L (14B parameters) is a model created by Apple researchers based on the Wan2.1-T2V-14B architecture and designed for real-time video generation with interactive latency. It is an autoregressive two-step diffusion model (a model that creates content through gradual noise removal) that outputs video at 480p resolution. The release includes an official implementation for running text-to-video (T2V) generation and interactive demos with camera control. The model is well-suited for researchers and developers of interactive media generation systems.
Key features
- Autoregressive two-step approach for generating video with interactive latency.
- Built on the powerful Wan2.1-T2V-14B model with distillation (a model compression process to speed up performance).
- Supports generating video at 832×480 resolution at a speed of 16 frames per second.
- Includes optimized components for efficient KV-cache caching and pixel processing.
What you can do
- Run text-to-video generation using repository scripts.
- Test interactive camera control using a demo application with LingBot integration.
- Evaluate generation quality and run benchmarks using VBench utilities.
- Use checkpoints for custom training or video model distillation.
Example
Running video generation from a text prompt:
uv run python scripts/generate.py --model ff-l --checkpoint-dir checkpoints \
--prompt "A corgi surfing a wave at sunset" --seed 0 --output outputs/corgi.mp4Read more
DetailsBenchmarks: replicates VBench results for quality and semantic evaluation.
Hardware requirements: Linux x86-64, NVIDIA GPU with CUDA 12.8 support (multiple GPUs recommended for FastFrames-L).
Training details: distillation from Wan2.1-14B using the Causal Forcing++ recipe and pixel decoder fine-tuning.
License: Apple Sample Code License.










Comments