Update: Kroma, A Krea-2 Fine Tune

[ I’m posting this on behalf of u/LodestoneRock since for some reason his post on this sub keep getting auto removed by Reddit. ]

Hey everyone, First of all, thank you to everyone for supporting this project, and to the Krea team who made the best uncompromised base model. Unlike the previous run, where I had to un-distill the model, the Krea team kindly provided us with their real base model. The training is much cheaper than the previous Chroma run. Though cheap is relative, it’s still costing me about ~10K RTX pro 6000 hours (3+ months on 4xGPU machine) running locally, this includes a bunch of failed experiments and bugs during training. Also thank you to ComfyOrg for the 2 RTX pro 6000 donations ♥️

The Base Krea is also not collapsed which allows me to do OPD (RL) directly ontop of it. As a result, you will get a good generation out of the box. Here are some results:

You can download them here: https://huggingface.co/lodestones/Kroma

(Civitai link soon)

So what’s next?

There are several stale projects like my pixel space run chroma radiance and zeta chroma, but with the limited compute, I have decided to not continue them for now since compute is at a premium atm. Right now the focus is to create a better dataset (where about 90% of the quality comes from) while continuing to add more knowledge to kroma in the background. I do want to tackle video generation models like h3 in the near future once the dataset curation is done, but fine tuning the video model has astronomical compute cost so I’m looking for funding for more hardware to train a model. I firmly believe that hardware funding donations help a ton because we can indefinitely do more experiments in a sustainable way without having to worry about rental cost and psychological burden of “burned money” on failed experiments. I have a target of getting 4 more RTX pro 6000 but that’s like 60 grand in total which is an insane amount of money! So I don’t expect to reach this goal immediately, it’s more about chipping in one card at a time at the pace of the accumulated donations. Every contribution helps, no matter the amount, this project simply isn’t possible without your support!

My discord: discord.gg/SQVcWVbqKx

[ I’ll let Lodestone post his support and donation links in a comment. ]