Many people reported that the lora training sucks for z-image base. Less than 12 hours ago, someone on Bilibili claimed that he/she found the cause – unit 8 used by AdamW8bit optimizer. According to the author, you have to use FP8 optimizer for z-image base. The author pasted some comparisons in his/her post. One can check check https://b23.tv/g7gUFIZ for more info.
submitted by /u/Recent-Source-7777
[link] [comments]
Hey, I found a pretty cool way to keep locations consistent across generations. I took…
The price of anything with memory is skyrocketing thanks to AI. Aging streaming devices are…
Anyone knows what could've been used here? Which model generates such photorealism? I've been using…
Multilingual self-supervised speech models can benefit from sharing information across languages, but under a matched…
What Hiring Managers value — and how they’ve built their careers at PalantirEditor’s Note: Technical Recruiter Rachel Vogel…
Checking tens of thousands of apartment leases against constantly changing state landlord-tenant laws, and proving…