Many people reported that the lora training sucks for z-image base. Less than 12 hours ago, someone on Bilibili claimed that he/she found the cause – unit 8 used by AdamW8bit optimizer. According to the author, you have to use FP8 optimizer for z-image base. The author pasted some comparisons in his/her post. One can check check https://b23.tv/g7gUFIZ for more info.
submitted by /u/Recent-Source-7777
[link] [comments]
Upgrade your WFH setup and work in style with these comfy, WIRED-tested seats.
Multimodal large language models (MLLMs), which process multiple types of sensory information, such as text,…
by Aarti Laddha, Richard Diaz-Cool, Rishika Idnani, Venkatesh SelverajNetflix supports a vast and evolving set…
As organizations embrace AI-powered analytics, the value of a natural language (Text2SQL) answer is only…
At Google, AI is a soup-to-nuts endeavor. Obviously, we make leading AI models like Gemini…
The impact will kick up a plume of debris so high, it’ll likely be visible…