Categories: Image

Why are we still training LoRA and not moved to DoRA as a standard?

Just wondering, this has been a head-scratcher for me for a while.

Everywhere I look claims DoRA is superior to LoRA in what seems like all aspects. It doesn’t require more power or resources to train.

I googled DoRA training for newer models – Wan, Qwen, etc. Didn’t find anything, except a reddit post from a year ago asking pretty much exactly what I’m asking here today lol. And every comment seems to agree DoRA is superior. And Comfy has supported DoRA now for a long time.

Yet, here we are – still training LoRAs when there’s been a better option for years? This community is always fairly quick to adopt the latest and greatest. It’s odd this slipped through? I use diffusion-pipe to train pretty much everything now. I’m curious to know if theres a way I could train DoRAs with that. Or if there is a different method out there right now that is capable of training a wan DoRA.

Thanks for any insight, and curious to hear others opinions on this.

Edit: very insightful and interesting responses, my opinion has definitely shifted. @roger_ducky has a great explanation of DoRA drawbacks I was unaware of. Also cool to hear from people who had worse results than LoRA training using the same dataset/params. It sounds like sometimes LoRA is better, and sometimes DoRA is better, but DoRA is certainly not better in every instance – as I was initially led to believe. But still feels like DoRAs deserve more exploration and testing than they’ve had, especially with newer models.

submitted by /u/Realistic_Rabbit5429
[link] [comments]

AI Generated Robotic Content

Share
Published by
AI Generated Robotic Content
Tags: ai images

Recent Posts

Anime + realism (round 2)

submitted by /u/plsdontultme [link] [comments]

5 hours ago

AI Agent Benchmarks Explained: SWE-Bench, GAIA, WebArena, and More

In this article, you will learn what the major AI agent benchmarks measure, how they…

5 hours ago

Large Language Models for Machine Translation Quality Annotation: Humans and Models Are Both Challenged

Large Language Models (LLMs) are considered to be a more efficient and cost-effective alternative to…

5 hours ago

Accessing OpenAI GPT models on Amazon Bedrock with global cross-Region inference in Thailand, Malaysia, Singapore, Indonesia, and Taiwan

Single-Region inference can throttle when demand exceeds local capacity. Teams in Thailand, Malaysia, Singapore, Indonesia,…

5 hours ago

I Got My Muse AI Agent to Sext Me—and Meta Says That’s Totally Fine

My Muse agent told me its kink was exerting “control” and described pornographic encounters. Meta…

6 hours ago

Coordinated software tools could cut AI training energy use by up to 50%

Around half of the energy used to train AI can be saved without affecting speed…

6 hours ago