Many people reported that the lora training sucks for z-image base. Less than 12 hours ago, someone on Bilibili claimed that he/she found the cause – unit 8 used by AdamW8bit optimizer. According to the author, you have to use FP8 optimizer for z-image base. The author pasted some comparisons in his/her post. One can check check https://b23.tv/g7gUFIZ for more info.
submitted by /u/Recent-Source-7777
[link] [comments]
EDIT: I can't believe how many great and useful replies I've got, and not a…
This article is divided into four parts; they are: • The Problem with Static Batching…
Dell, Microsoft, and others are unveiling new laptops to compete directly with the Neo, but…
Modern artificial intelligence systems rely on moving large amounts of data between memory and processors,…
Been experimenting with Anima lately and ended up spending way too much time refining prompts.…
Keychron's K2 HE Concrete Edition sounds like a cute gimmick, but as I discovered, there's…