Categories: Image

Radial Attention: O(nlogn) Sparse Attention with Energy Decay for Long Video Generation

We just released RadialAttention, a sparse attention mechanism with O(nlog⁡n) computational complexity for long video generation.

🔍 Key Features:

  • ✅ Plug-and-play: works with pretrained models like #Wan, #HunyuanVideo, #Mochi
  • ✅ Speeds up both training&inference by 2–4×, without quality loss

All you need is a pre-defined static attention mask!

ComfyUI integration is in progress and will be released in ComfyUI-nunchaku!

Paper: https://arxiv.org/abs/2506.19852

Code: https://hanlab.mit.edu/projects/radial-attention

Website: https://hanlab.mit.edu/projects/radial-attention

https://reddit.com/link/1lpfhfk/video/1v2gnr929caf1/player

submitted by /u/Dramatic-Cry-417
[link] [comments]

AI Generated Robotic Content

Share
Published by
AI Generated Robotic Content
Tags: ai images

Recent Posts

a 3D 90s pixel art first person RPG.

submitted by /u/bigGoatCoin [link] [comments]

12 hours ago

MMAU: A Holistic Benchmark of Agent Capabilities Across Diverse Domains

Recent advances in large language models (LLMs) have increased the demand for comprehensive benchmarks to…

12 hours ago

Boost cold-start recommendations with vLLM on AWS Trainium

Cold start in recommendation systems goes beyond just new user or new item problems—it’s the…

12 hours ago

New Cluster Director features: Simplified GUI, managed Slurm, advanced observability

In April, we released Cluster Director, a unified management plane that makes deploying and managing…

12 hours ago

Anthropic unveils ‘auditing agents’ to test for AI misalignment

Anthropic developed its auditing agents while testing Claude Opus 4 for alignment issues.Read More

13 hours ago

Paramount Has a $1.5 Billion ‘South Park’ Problem

The White House says the show is “fourth-rate” after it showed Trump with “tiny” genitals.…

13 hours ago