Many people reported that the lora training sucks for z-image base. Less than 12 hours ago, someone on Bilibili claimed that he/she found the cause – unit 8 used by AdamW8bit optimizer. According to the author, you have to use FP8 optimizer for z-image base. The author pasted some comparisons in his/her post. One can check check https://b23.tv/g7gUFIZ for more info.
submitted by /u/Recent-Source-7777
[link] [comments]
Take your home office to new heights with our favorite motorized standing desks.
Some weeks ago, I posted a set of experiments to "understand" the physical knowledge of…
Sign language processing systems have traditionally operated at the sentence level, ignoring critical discourse phenomena…
Multi-agent systems in production experience issues in ways that traditional monitoring misses. For example, the…
South Park, Slow Horses, Neon Genesis Evangelion, and a Lego-fied Mandalorian are just a few…