Categories: Image

Update: Kroma, A Krea-2 Fine Tune

[ I’m posting this on behalf of u/LodestoneRock since for some reason his post on this sub keep getting auto removed by Reddit. ]

Hey everyone, First of all, thank you to everyone for supporting this project, and to the Krea team who made the best uncompromised base model. Unlike the previous run, where I had to un-distill the model, the Krea team kindly provided us with their real base model. The training is much cheaper than the previous Chroma run. Though cheap is relative, it’s still costing me about ~10K RTX pro 6000 hours (3+ months on 4xGPU machine) running locally, this includes a bunch of failed experiments and bugs during training. Also thank you to ComfyOrg for the 2 RTX pro 6000 donations ♥️

The Base Krea is also not collapsed which allows me to do OPD (RL) directly ontop of it. As a result, you will get a good generation out of the box. Here are some results:

You can download them here: https://huggingface.co/lodestones/Kroma

(Civitai link soon)

So what’s next?

There are several stale projects like my pixel space run chroma radiance and zeta chroma, but with the limited compute, I have decided to not continue them for now since compute is at a premium atm. Right now the focus is to create a better dataset (where about 90% of the quality comes from) while continuing to add more knowledge to kroma in the background. I do want to tackle video generation models like h3 in the near future once the dataset curation is done, but fine tuning the video model has astronomical compute cost so I’m looking for funding for more hardware to train a model. I firmly believe that hardware funding donations help a ton because we can indefinitely do more experiments in a sustainable way without having to worry about rental cost and psychological burden of “burned money” on failed experiments. I have a target of getting 4 more RTX pro 6000 but that’s like 60 grand in total which is an insane amount of money! So I don’t expect to reach this goal immediately, it’s more about chipping in one card at a time at the pace of the accumulated donations. Every contribution helps, no matter the amount, this project simply isn’t possible without your support!

My discord: discord.gg/SQVcWVbqKx

[ I’ll let Lodestone post his support and donation links in a comment. ]

submitted by /u/KadahCoba
[link] [comments]

AI Generated Robotic Content

Share
Published by
AI Generated Robotic Content
Tags: ai images

Recent Posts

Combatting adversarial distillation

OpenAI’s layered approach to adversarial distillation combines model training, safeguards, detection, and enforcement to protect…

11 hours ago

7 Ways AI Agents Fail in Production (and How to Catch Each One)

Three events that look alike need separate names.

11 hours ago

Depth Pro 2: Sharp and Temporally Consistent Metric Monocular Depth

We present Depth Pro 2, an approach to estimating dense metric depth for images and…

11 hours ago

New in AWS Quick: More capable flows, an updated web experience, and agents that work together

Turn one person’s process into your team’s process, get more done in the Quick web…

11 hours ago

Ultimate guide for fixing your team’s API keys

Most Gemini prototypes start the same way. You grab an API key from Google AI…

11 hours ago

Cops Are Pushing Extremely Corny ‘Grand Theft Auto 6’ Slop

The blockbuster game makes no secret of its contempt for law enforcement. Real police departments…

12 hours ago