Categories: Image

Why are we still training LoRA and not moved to DoRA as a standard?

Just wondering, this has been a head-scratcher for me for a while.

Everywhere I look claims DoRA is superior to LoRA in what seems like all aspects. It doesn’t require more power or resources to train.

I googled DoRA training for newer models – Wan, Qwen, etc. Didn’t find anything, except a reddit post from a year ago asking pretty much exactly what I’m asking here today lol. And every comment seems to agree DoRA is superior. And Comfy has supported DoRA now for a long time.

Yet, here we are – still training LoRAs when there’s been a better option for years? This community is always fairly quick to adopt the latest and greatest. It’s odd this slipped through? I use diffusion-pipe to train pretty much everything now. I’m curious to know if theres a way I could train DoRAs with that. Or if there is a different method out there right now that is capable of training a wan DoRA.

Thanks for any insight, and curious to hear others opinions on this.

Edit: very insightful and interesting responses, my opinion has definitely shifted. @roger_ducky has a great explanation of DoRA drawbacks I was unaware of. Also cool to hear from people who had worse results than LoRA training using the same dataset/params. It sounds like sometimes LoRA is better, and sometimes DoRA is better, but DoRA is certainly not better in every instance – as I was initially led to believe. But still feels like DoRAs deserve more exploration and testing than they’ve had, especially with newer models.

submitted by /u/Realistic_Rabbit5429
[link] [comments]

AI Generated Robotic Content

Share
Published by
AI Generated Robotic Content
Tags: ai images

Recent Posts

Sorry guys

How the time has changed... submitted by /u/amokerajvosa [link] [comments]

3 hours ago

Monitoring Embedding Drift in Production Scikit-LLM Pipelines

In this article, you will learn what embedding drift is, why it matters for production…

3 hours ago

Bring more intelligence to everyday work with GPT-6 Sol and GPT-6 Luna on Amazon Bedrock

GPT-6 Sol and GPT-6 Luna are now generally available on Amazon Bedrock, giving you more…

3 hours ago

How to Claim Your Cut of Apple’s $250 Million Siri Settlement

Apple may pay out up to $95 for each eligible iPhone purchased by someone who…

4 hours ago

MIT’s tiny flying robot gets 450% faster with AI

A new AI control system lets MIT’s tiny flying robot move with insect-like agility, boosting…

4 hours ago

Scientists develop real-time AI monitoring for an advanced nuclear reactor component

Just as a clogged kitchen sink can bring household routines to a halt, a blockage…

4 hours ago