Categories: Image

Update: Kroma, A Krea-2 Fine Tune

[ I’m posting this on behalf of u/LodestoneRock since for some reason his post on this sub keep getting auto removed by Reddit. ]

Hey everyone, First of all, thank you to everyone for supporting this project, and to the Krea team who made the best uncompromised base model. Unlike the previous run, where I had to un-distill the model, the Krea team kindly provided us with their real base model. The training is much cheaper than the previous Chroma run. Though cheap is relative, it’s still costing me about ~10K RTX pro 6000 hours (3+ months on 4xGPU machine) running locally, this includes a bunch of failed experiments and bugs during training. Also thank you to ComfyOrg for the 2 RTX pro 6000 donations ♥️

The Base Krea is also not collapsed which allows me to do OPD (RL) directly ontop of it. As a result, you will get a good generation out of the box. Here are some results:

You can download them here: https://huggingface.co/lodestones/Kroma

(Civitai link soon)

So what’s next?

There are several stale projects like my pixel space run chroma radiance and zeta chroma, but with the limited compute, I have decided to not continue them for now since compute is at a premium atm. Right now the focus is to create a better dataset (where about 90% of the quality comes from) while continuing to add more knowledge to kroma in the background. I do want to tackle video generation models like h3 in the near future once the dataset curation is done, but fine tuning the video model has astronomical compute cost so I’m looking for funding for more hardware to train a model. I firmly believe that hardware funding donations help a ton because we can indefinitely do more experiments in a sustainable way without having to worry about rental cost and psychological burden of “burned money” on failed experiments. I have a target of getting 4 more RTX pro 6000 but that’s like 60 grand in total which is an insane amount of money! So I don’t expect to reach this goal immediately, it’s more about chipping in one card at a time at the pace of the accumulated donations. Every contribution helps, no matter the amount, this project simply isn’t possible without your support!

My discord: discord.gg/SQVcWVbqKx

[ I’ll let Lodestone post his support and donation links in a comment. ]

submitted by /u/KadahCoba
[link] [comments]

AI Generated Robotic Content

Share
Published by
AI Generated Robotic Content
Tags: ai images

Recent Posts

I Made Terrible Games With Google’s AI Playground

A long day’s haul in the video game slop mines.

2 hours ago

Nvidia is now rumored to be ending the 5090 and possibly replacing it with a 24GB 5080.

submitted by /u/Enshitification [link] [comments]

1 day ago

AI Is Getting Really Good at Messing With Cybercriminals

Anti-cybercrime initiatives are increasingly using AI to scam the scammers by tricking them into talking…

1 day ago

A new approach to sustainable AI: Offloading part of the computational burden onto light

As artificial intelligence technologies become increasingly widespread, the growing demand for processing power and energy…

1 day ago

The Power of Reference Videos for Believable Acting in Minimax

A while ago u/R34vspec, at my suggestion, used reference videos to influence the actors. https://www.reddit.com/r/StableDiffusion/s/AiURgoCkgj…

2 days ago

How to Fine-Tune Llama 3 for Custom Tool Calling with Unsloth in Python

Llama 3 is a capable generalist, but that's exactly the problem when you need an…

2 days ago