| | https://huggingface.co/bytedance-research/UMO Bytedance have released 3 days ago their image editing/creation model UMO. From their huggingface description: Recent advancements in image customization exhibit a wide range of application prospects due to stronger customization capabilities. However, since we humans are more sensitive to faces, a significant challenge remains in preserving consistent identity while avoiding identity confusion with multi-reference images, limiting the identity scalability of customization models. To address this, we present UMO, a Unified Multi-identity Optimization framework, designed to maintain high-fidelity identity preservation and alleviate identity confusion with scalability. With βmulti-to-multi matchingβ paradigm, UMO reformulates multi-identity generation as a global assignment optimization problem and unleashes multi-identity consistency for existing image customization methods generally through reinforcement learning on diffusion models. To facilitate the training of UMO, we develop a scalable customization dataset with multi-reference images, consisting of both synthesised and real parts. Additionally, we propose a new metric to measure identity confusion. Extensive experiments demonstrate that UMO not only improves identity consistency significantly, but also reduces identity confusion on several image customization methods, setting a new state-of-the-art among open-source methods along the dimension of identity preserving. submitted by /u/AgeNo5351 |
So, after the recent anime clip posted here a few days ago that got a…
We tested the best electric bikes in every category, from commuters and mountain bikes to…
In a Nature Communications study, researchers from China have developed an error-aware probabilistic update (EaPU)…
My setup: RTX 3060 12GB VRAM + 48GB system RAM. I spent the last couple…
Humans pay enormous attention to lips during conversation, and robots have struggled badly to keep…
Suppose youβve built your machine learning model, run the experiments, and stared at the results…