Many people reported that the lora training sucks for z-image base. Less than 12 hours ago, someone on Bilibili claimed that he/she found the cause – unit 8 used by AdamW8bit optimizer. According to the author, you have to use FP8 optimizer for z-image base. The author pasted some comparisons in his/her post. One can check check https://b23.tv/g7gUFIZ for more info.
submitted by /u/Recent-Source-7777
[link] [comments]
Not just a meme... submitted by /u/takayatodoroki [link] [comments]
The Asus PG27UCWM brings a new sub-pixel layout to the world of OLED gaming monitors,…
Chinese humanoid robots broke records set by humans, including beating Usain Bolt's 100-meter sprint world…
For uninterrupted service as you country-hop, the Saily Ultra eSIM works well and comes with…
Everyone is familiar with the situation: A larger group of people plans to visit a…
Samuel Yeboah, Francesco Di Chiara and Mingliang LiuToday, Netflix runs two Flink autoscalers. That is…