So in the past few weeks I have been dedicating long hours into finding optimal approaches to preserve as much of the ref latent inside and basically force the model to do two things; preserve the features and be flexible and it has been such pain but I think I stumbled accidentally many interesting features of this model and it’s architecture.. as I tinkered with every possible corner you can tinker with from conds to attn layers to all q,k,v … double and single blocks and more.. overall all I found some valuable information for people who would like to train loras and knowing what to actually target.. and I was wrong while back by publishing a map of where the character lives.. anyways here we go:
Double blocks 0-1 is just base early on where the model is just doing its thing, poses and such are beginning to form here.
Double 2-3 is where the model recognizes the colors of outfit but no outfit / character yet.
Double 4-5 is where the model locks the outfit/ body proportions but not the character’s facial features.
6-7 is where the model locks the character/outfit/features.
Singles 0-23 all just model’s style and textures no actual physical changes nor proportions or features .
And finally yes I need a break from this model.. 😂
submitted by /u/Capitan01R-
[link] [comments]