Categories: Image

Radial Attention: O(nlogn) Sparse Attention with Energy Decay for Long Video Generation

We just released RadialAttention, a sparse attention mechanism with O(nlog⁡n) computational complexity for long video generation.

🔍 Key Features:

  • ✅ Plug-and-play: works with pretrained models like #Wan, #HunyuanVideo, #Mochi
  • ✅ Speeds up both training&inference by 2–4×, without quality loss

All you need is a pre-defined static attention mask!

ComfyUI integration is in progress and will be released in ComfyUI-nunchaku!

Paper: https://arxiv.org/abs/2506.19852

Code: https://hanlab.mit.edu/projects/radial-attention

Website: https://hanlab.mit.edu/projects/radial-attention

https://reddit.com/link/1lpfhfk/video/1v2gnr929caf1/player

submitted by /u/Dramatic-Cry-417
[link] [comments]

AI Generated Robotic Content

Share
Published by
AI Generated Robotic Content
Tags: ai images

Recent Posts

I love Qwen

It is far more likely that a woman underwater is wearing at least a bikini…

13 hours ago

100% Unemployment is Inevitable*

TL;DR AI is already raising unemployment in knowledge industries, and if AI continues progressing toward…

13 hours ago

Sample and Map from a Single Convex Potential: Generation using Conjugate Moment Measures

The canonical approach in generative modeling is to split model fitting into two blocks: define…

13 hours ago

Streamline AI operations with the Multi-Provider Generative AI Gateway reference architecture

As organizations increasingly adopt AI capabilities across their applications, the need for centralized management, security,…

13 hours ago

BigQuery AI: The convergence of data and AI is here

From uncovering new insights in multimodal data to personalizing customer experiences, AI is emerging as…

13 hours ago

OpenAI is ending API access to fan-favorite GPT-4o model in February 2026

OpenAI has sent out emails notifying API customers that its chatgpt-4o-latest model will be retired…

14 hours ago