Many people reported that the lora training sucks for z-image base. Less than 12 hours ago, someone on Bilibili claimed that he/she found the cause – unit 8 used by AdamW8bit optimizer. According to the author, you have to use FP8 optimizer for z-image base. The author pasted some comparisons in his/her post. One can check check https://b23.tv/g7gUFIZ for more info.
submitted by /u/Recent-Source-7777
[link] [comments]
Project Hail Mary, They Will Kill You, and The Long Walk are among the films…
A new study suggests the brain begins making decisions much earlier than scientists previously thought.…
The safety performance of autonomous vehicle (AV) algorithms is boosted by 90% using simulation data…
In at least two places, Uber has pushed a policy that could give it an…
The AquaSense X brings self-cleaning technology to pool robots for the first time, but is…
In this article, you will learn how to choose the right memory strategy for an…