Categories: Image

Radial Attention: O(nlogn) Sparse Attention with Energy Decay for Long Video Generation

We just released RadialAttention, a sparse attention mechanism with O(nlog⁡n) computational complexity for long video generation.

🔍 Key Features:

  • ✅ Plug-and-play: works with pretrained models like #Wan, #HunyuanVideo, #Mochi
  • ✅ Speeds up both training&inference by 2–4×, without quality loss

All you need is a pre-defined static attention mask!

ComfyUI integration is in progress and will be released in ComfyUI-nunchaku!

Paper: https://arxiv.org/abs/2506.19852

Code: https://hanlab.mit.edu/projects/radial-attention

Website: https://hanlab.mit.edu/projects/radial-attention

https://reddit.com/link/1lpfhfk/video/1v2gnr929caf1/player

submitted by /u/Dramatic-Cry-417
[link] [comments]

AI Generated Robotic Content

Share
Published by
AI Generated Robotic Content
Tags: ai images

Recent Posts

The Current State of Agentic AI

In this article, you will learn how agentic AI architecture has evolved by mid-2026, including…

20 hours ago

Environment-free Synthetic Data Generation for API-Calling Agents

Training API-calling large language model (LLM) agents demands massive amounts of high-quality trajectories. However, collecting…

20 hours ago

Exploring self-distilled reasoning for supervised fine-tuning with Amazon Nova

When you fine-tune a model using Supervised Fine-Tuning (SFT), creating high-quality chain-of-thought (CoT) reasoning traces…

20 hours ago

Why AI apps fail in production (And how Google solved it)

We are living in the golden age of the weekend AI side project. Thanks to…

20 hours ago

Is the All-New Range Rover GT Stepping on Jaguar’s Tail?

It’s “the most car-like Range Rover ever created,” but will this all-electric grand tourer spoil…

21 hours ago

AI detects ‘personalities’ of individual 3D printers to cut manufacturing errors

Imagine buying three identical 3D printers. Despite being the same brand, the same model and…

21 hours ago