Categories: Image

Radial Attention: O(nlogn) Sparse Attention with Energy Decay for Long Video Generation

We just released RadialAttention, a sparse attention mechanism with O(nlog⁡n) computational complexity for long video generation.

🔍 Key Features:

  • ✅ Plug-and-play: works with pretrained models like #Wan, #HunyuanVideo, #Mochi
  • ✅ Speeds up both training&inference by 2–4×, without quality loss

All you need is a pre-defined static attention mask!

ComfyUI integration is in progress and will be released in ComfyUI-nunchaku!

Paper: https://arxiv.org/abs/2506.19852

Code: https://hanlab.mit.edu/projects/radial-attention

Website: https://hanlab.mit.edu/projects/radial-attention

https://reddit.com/link/1lpfhfk/video/1v2gnr929caf1/player

submitted by /u/Dramatic-Cry-417
[link] [comments]

AI Generated Robotic Content

Share
Published by
AI Generated Robotic Content
Tags: ai images

Recent Posts

Retrieval vs. Memory in Agentic AI Systems

In this article, you will learn the conceptual and practical differences between retrieval and memory…

5 hours ago

Here is What I am Building In Public

Hi everyone,In my last post, and I know its been a while, I promised to…

5 hours ago

Part 2: Amazon Bedrock cost attribution with Amazon Athena and CUDOS

Part 1 introduced granular cost attribution for Amazon Bedrock. This feature automatically traces every inference…

5 hours ago

The Best Photos of the Big August Solar Eclipse

It’s been a century since the Iberian Peninsula has been in the full shadow of…

6 hours ago

Extending AI architectures to address continuous scientific problems

Artificial intelligence is proving to be transformative in its ability to work with language and…

6 hours ago

7 Async Patterns for Running Agents Concurrently in Python

In this article, you will learn seven async patterns for running AI agents concurrently in…

1 day ago