So in the past few weeks I have been dedicating long hours into finding optimal approaches to preserve as much of the ref latent inside and basically force the model to do two things; preserve the features and be flexible and it has been such pain but I think I stumbled accidentally many interesting features of this model and it’s architecture.. as I tinkered with every possible corner you can tinker with from conds to attn layers to all q,k,v … double and single blocks and more.. overall all I found some valuable information for people who would like to train loras and knowing what to actually target.. and I was wrong while back by publishing a map of where the character lives.. anyways here we go:
Double blocks 0-1 is just base early on where the model is just doing its thing, poses and such are beginning to form here.
Double 2-3 is where the model recognizes the colors of outfit but no outfit / character yet.
Double 4-5 is where the model locks the outfit/ body proportions but not the character’s facial features.
6-7 is where the model locks the character/outfit/features.
Singles 0-23 all just model’s style and textures no actual physical changes nor proportions or features .
And finally yes I need a break from this model.. 😂
submitted by /u/Capitan01R-
[link] [comments]
A few weeks ago I introduced a new method for training style LoRAs which has…
When large language models, or LLMs for short, produce outputs, several criteria are at stake,…
Financial institutions process thousands of documents daily, including tax forms, loan statements, and purchase orders.…
aside_block <ListValue: [StructValue([('title', 'Summary of today’s news'), ('body', <wagtail.rich_text.RichText object at 0x7f00683723a0>), ('btn_text', ''), ('href',…
The bill requires companies like OpenAI, Anthropic, and Google to have third parties confirm they’re…
New research from the University of the Witwatersrand, South Africa, has significant implications for understanding…