We just released RadialAttention, a sparse attention mechanism with O(nlog⁡n) computational complexity for long video generation.

🔍 Key Features:

• ✅ Plug-and-play: works with pretrained models like #Wan, #HunyuanVideo, #Mochi
• ✅ Speeds up both training&inference by 2–4×, without quality loss

All you need is a pre-defined static attention mask!

ComfyUI integration is in progress and will be released in ComfyUI-nunchaku!

Paper: https://arxiv.org/abs/2506.19852

Code: https://hanlab.mit.edu/projects/radial-attention

Website: https://hanlab.mit.edu/projects/radial-attention

https://reddit.com/link/1lpfhfk/video/1v2gnr929caf1/player