Categories: Image

Why are we still training LoRA and not moved to DoRA as a standard?

Just wondering, this has been a head-scratcher for me for a while.

Everywhere I look claims DoRA is superior to LoRA in what seems like all aspects. It doesn’t require more power or resources to train.

I googled DoRA training for newer models – Wan, Qwen, etc. Didn’t find anything, except a reddit post from a year ago asking pretty much exactly what I’m asking here today lol. And every comment seems to agree DoRA is superior. And Comfy has supported DoRA now for a long time.

Yet, here we are – still training LoRAs when there’s been a better option for years? This community is always fairly quick to adopt the latest and greatest. It’s odd this slipped through? I use diffusion-pipe to train pretty much everything now. I’m curious to know if theres a way I could train DoRAs with that. Or if there is a different method out there right now that is capable of training a wan DoRA.

Thanks for any insight, and curious to hear others opinions on this.

Edit: very insightful and interesting responses, my opinion has definitely shifted. @roger_ducky has a great explanation of DoRA drawbacks I was unaware of. Also cool to hear from people who had worse results than LoRA training using the same dataset/params. It sounds like sometimes LoRA is better, and sometimes DoRA is better, but DoRA is certainly not better in every instance – as I was initially led to believe. But still feels like DoRAs deserve more exploration and testing than they’ve had, especially with newer models.

submitted by /u/Realistic_Rabbit5429
[link] [comments]

AI Generated Robotic Content

Share
Published by
AI Generated Robotic Content
Tags: ai images

Recent Posts

REFACTOR-VLA: Unsupervised Library Learning of Typed Motor Programs

Most current vision-language-action (VLA) models—such as OpenVLA, π0, RT-2, and RDT-1B—are “monolithic.” This means they…

14 mins ago

Accessing OpenAI models on Amazon Bedrock from Australia with global cross-Region inference

Australian teams working with OpenAI models can now access the latest OpenAI models through Amazon…

14 mins ago

Getting started with Mantis, our open-source bug finding-and-fixing harness

AI models have clearly proven their ability to discover and exploit vulnerabilities without much, if…

14 mins ago

Meta Pushes Its New AI Agent on Employees—but Eases Off on Tokenmaxxing

The company is reducing pressure on workers to use artificial intelligence tools while encouraging them…

1 hour ago

Why did your robotaxi stop? New system helps predict self-driving car mistakes

Self-driving cars are often controlled by deep learning models that sometimes fail in unexpected situations.…

1 hour ago

Introducing Claude Fable 5.1 on AWS

Today, we’re excited to announce the availability of Claude Fable 5.1 on Amazon Bedrock and…

1 day ago