Categories: Image

Wan 2.2 Realism, Motion and Emotion.

The main idea for this video was to get as realistic and crisp visuals as possible without the need to disguise the smeared bland textures and imperfections with heavy film grain, as is usually done after heavy upscaling. Therefore, there is zero film grain here. The second idea was to make it different from the usual high quality robotic girl looking at the mirror holding a smartphone. I intended to get as much emotion as I can, with things like subtle mouth movement, eye rolls, brow movement and focus shifts. And wan can do this nicely, i’m surprised that most people ignore it.

Now some info and tips:

The starting images were made by using LOTS of steps, up to 60, upscaled to 4k using seedvr2 and finetuned if needed.

All consistency was achieved only by loras and prompting, so there are some inconsistencies like jewelry or watches, the character also changed a little, due to character lora change mid clips generations.

Not a single nano banana was hurt making this, I insisted to sticking to pure wan 2.2 to keep it 100% locally generated, despite knowing many artifacts could be corrected by edits.

I’m just stubborn.

I found myself held back by quality of my loras, they were just not good enough and needed to be remade. Then I felt held back again a little bit less, because i’m not that good at making loras 🙂 Still, I left some of the old footage, so the quality difference in the output can be seen here and there.

Most of the dynamic motion generations vere incredibly high noise heavy (65-75% compute on high noise) with between 6-8 steps low noise using speed up lora. Used dozen of workflows with various schedulers, sigma curves (0.9 for i2v) end eta, depending on the scene needs. It’s all basically a bongmath with implicit steps/substeps, depending on the sampler used. All and starting images and clips were subject of verbose prompt, with most of the thing prompted, up to dirty windows and crumpled clothes, leaving not much for the model to hallucinate. I generated using 1536×864 resolution.

The whole thing took mostly two weekends to be made, with lora training and a clip or two every other day because didn’t have time for it on the weekdays. Then I decided to remake half of it this weekend, because it turned out to be far too dark to be shown to general public. Therefore, I gutted the sex and most of the gore/violence scenes. In the end it turned out more wholesome, less psychokiller-ish, diverting from the original Bonnie&Clyde idea.

Apart from some artifacts and inconsistencies, you can see a flickering of background in some scenes, caused by SEEDVR2 upscaler, happening more or less every 2,5sec. This is caused by my inability to upscale whole clip in one batch, and the moment of joining the batches is visible. Using card like like rtx 6000 with 96gb ram would probably solve this. Moreover i’m conflicted with going 2k resolution here, now I think 1080p would be enough, and the reddit player only allows for 1080p anyways.

Higher quality 2k resolution on YT:
https://www.youtube.com/watch?v=DVy23Raqz2k

submitted by /u/Ashamed-Variety-8264
[link] [comments]

AI Generated Robotic Content

Share
Published by
AI Generated Robotic Content
Tags: ai images

Recent Posts

The PHP Meltdown Shows How AI Makes Bugs More Exploitable

Security researchers used AI tools to help uncover years-old vulnerabilities in the PHP web scripting…

19 hours ago

Wearable system captures human activity data for robot training

Humanoid robots, robotic systems with a body shape that resembles that of humans, could tackle…

19 hours ago

Speculative Decoding Explained: How to Get 3× Faster Inference from Any LLM

In this article, you will learn how speculative decoding works, why it produces real speed…

2 days ago

Beyond API Compatibility: Building a Tool to Measure the Blast Radius of Library Changes

By Roberto Perez Alcolea, Java Platform TeamQuasar connects a proposed API change with observed references in…

2 days ago

Multi-Turn Reinforcement Learning on Amazon SageMaker AI: A hands-on guide

Most fine-tuning teaches a model to produce a better answer to a single prompt. Agentic…

2 days ago

Revival Rugs Birthday Sale: 20 Percent Off Sitewide Through Sunday

The brand’s lovely selection of hand-knotted and handwoven wool rugs at reasonable prices make it…

2 days ago