CLIP is back on Anima, because CLIP is eternal.

CLIP is back on Anima, because CLIP is eternal.

You thought you can get away from it? Never.

https://preview.redd.it/ucku0gzegqlg1.png?width=743&format=png&auto=webp&s=2f349550205028c6e18e4b72aa9144304d2c1e75

Guys at Yandex and Adobe implemented CLIP for bunch of models that don’t use it – https://github.com/quickjkee/modulation-guidance

I made it into ComfyUI node for Anima – https://github.com/Anzhc/Anima-Mod-Guidance-ComfyUI-Node

For images above and below i used CLIP L from here – https://huggingface.co/Anzhc/Noobai11-CLIP-L-and-BigG-Anime-Text-Encoders

Basic CLIP L also works, but your mileage may vary, every CLIP has different effect.

Unfortunately it won’t let you use weighting as on SDXL, but from what i tested that also was a bit better at least.

So what are the benefits anyway?

From what i tested(Left is base Anima, right with Modulation Guidance):

– Can reduce color leaks

https://preview.redd.it/ush1cgt9hqlg1.png?width=2501&format=png&auto=webp&s=968ea21bdbf5a89648c04502bb391965d9640151

(necktie is not even prompted)

– Improve composition and stability

https://preview.redd.it/67a60iirhqlg1.png?width=2070&format=png&auto=webp&s=8268d0c1cbc3b4c95f44e091fc44e0a5864c7529

(Yes, i picked the funniest example, sue me)
That particular prompt i ran like 10 times, few of them it would show another issue:

– Beach

https://preview.redd.it/efvihns8iqlg1.png?width=2067&format=png&auto=webp&s=c61db50a509ab6772b74e60fb4834f0784dc7750

For no reason whatsoever, Anima LOVES to default to ocean or beach, that effect is reduced with CLIP.

– Less unprompted horny (I know for most of you this is a negative though)

https://preview.redd.it/b9byqkhkiqlg1.png?width=2286&format=png&auto=webp&s=800d55d03dcbe5a53d403b6b6a310e826bc5a25e

(Afterimages prompted, i just wanted her to sweep floors…)

– Little bit better (from what i tested) character separation, and adherence to character look

https://preview.redd.it/hk1ye4pviqlg1.png?width=2507&format=png&auto=webp&s=6452c13d141cc1cf4c738c8c7d055cce3288c7e5

But it still largely relies on base model understanding in this aspect.

– Can also improve quality in general (subjective)

https://preview.redd.it/yhlkikw6jqlg1.png?width=1827&format=png&auto=webp&s=bd80337bb128773a19c9825cb426d7900272dd55

– Less 1girl bias (prompt is just `masterpiece, best quality, scenery`)

https://preview.redd.it/h681h5jnjqlg1.png?width=2588&format=png&auto=webp&s=df37a3c08f320d5a6877b28b13e2349f71a6a358

https://preview.redd.it/elapkpktjqlg1.png?width=2112&format=png&auto=webp&s=f0d0aefda7ae627a3afba40a20695b296a8e0e9f

https://preview.redd.it/9gdbycuyjqlg1.png?width=2114&format=png&auto=webp&s=0e749ae327f2390d762d165d6fe9c240374cdfd6

I primarily tested with tags only, while i did test with some NL, i generally don’t have much luck with it on Anima, for me it’s unstable and inconsistent, so i’ll leave it to you to find if CLIP is helping there or not.

P.S. All girls in images are clothed/in bikini, i just censored them to keep it safe. But i really can’t emphasize how horny Anima is by default…

It’s easy to use, and i’ve included prepared workflow for you to compare both results for yourself:

https://preview.redd.it/u6bue5hulqlg1.png?width=2742&format=png&auto=webp&s=2fbead9bb4da338312d1055b3e16de4a12bce2c4

You can find it in repo. To use it, you don’t need to write a prompt for it every time, generally you just use it as secondary quality tags, and wire negative and base in from main prompts.

Based on official repo, you can tune it to affect different things, but i haven’t tried using it like that, so up to you to test it.

That’s it. Have fun. Till next time.

Also

She’s just like me frfr

https://preview.redd.it/7r0b9lx8kqlg1.png?width=555&format=png&auto=webp&s=f375ad6d8b5bf587f876416d5bd8193af0ba11fd

If you’re here, here are links from the top of post so you don’t have to scroll:

Original implementation – https://github.com/quickjkee/modulation-guidance

ComfyUI node for Anima – https://github.com/Anzhc/Anima-Mod-Guidance-ComfyUI-Node

Workflows also can be found right in node repo.

For images above i used CLIP L from here – https://huggingface.co/Anzhc/Noobai11-CLIP-L-and-BigG-Anime-Text-Encoders

submitted by /u/Anzhc
[link] [comments]