Many people reported that the lora training sucks for z-image base. Less than 12 hours ago, someone on Bilibili claimed that he/she found the cause – unit 8 used by AdamW8bit optimizer. According to the author, you have to use FP8 optimizer for z-image base. The author pasted some comparisons in his/her post. One can check check https://b23.tv/g7gUFIZ for more info.
submitted by /u/Recent-Source-7777
[link] [comments]
During a hearing Tuesday, a district court judge questioned the Department of Defense’s motivations for…
Researchers have discovered that some of the elements of AI neural networks that contribute to…
If you look at the architecture diagram of almost any AI startup today, you will…
Memory is one of the most overlooked parts of agentic system design.
In the modern AI landscape, an agent loop is a cyclic, repeatable, and continuous process…