So in the past few weeks I have been dedicating long hours into finding optimal approaches to preserve as much of the ref latent inside and basically force the model to do two things; preserve the features and be flexible and it has been such pain but I think I stumbled accidentally many interesting features of this model and it’s architecture.. as I tinkered with every possible corner you can tinker with from conds to attn layers to all q,k,v … double and single blocks and more.. overall all I found some valuable information for people who would like to train loras and knowing what to actually target.. and I was wrong while back by publishing a map of where the character lives.. anyways here we go:
Double blocks 0-1 is just base early on where the model is just doing its thing, poses and such are beginning to form here.
Double 2-3 is where the model recognizes the colors of outfit but no outfit / character yet.
Double 4-5 is where the model locks the outfit/ body proportions but not the character’s facial features.
6-7 is where the model locks the character/outfit/features.
Singles 0-23 all just model’s style and textures no actual physical changes nor proportions or features .
And finally yes I need a break from this model.. 😂
submitted by /u/Capitan01R-
[link] [comments]
Hi, I'm Dever and I like training LORAs, you can download this one from Huggingface…
Traditional machine learning pipelines for predictive tasks like text classification usually rely on extracting structured,…
Today, we’re announcing a new API with Amazon Bedrock Guardrails. With this API, you can…
For technology companies like Siemens, software is the nervous system of factories, energy grids, and…
Whether you’re at a festival, tennis match, or wedding, these hand fans and wearable cooling…
A research team led by Professor Taesung Kim of the School of Mechanical Engineering at…