Many people reported that the lora training sucks for z-image base. Less than 12 hours ago, someone on Bilibili claimed that he/she found the cause – unit 8 used by AdamW8bit optimizer. According to the author, you have to use FP8 optimizer for z-image base. The author pasted some comparisons in his/her post. One can check check https://b23.tv/g7gUFIZ for more info.
submitted by /u/Recent-Source-7777
[link] [comments]
Security researchers used AI tools to help uncover years-old vulnerabilities in the PHP web scripting…
Humanoid robots, robotic systems with a body shape that resembles that of humans, could tackle…
In this article, you will learn how speculative decoding works, why it produces real speed…
By Roberto Perez Alcolea, Java Platform TeamQuasar connects a proposed API change with observed references in…
Most fine-tuning teaches a model to produce a better answer to a single prompt. Agentic…
The brand’s lovely selection of hand-knotted and handwoven wool rugs at reasonable prices make it…