| | https://huggingface.co/bytedance-research/UMO Bytedance have released 3 days ago their image editing/creation model UMO. From their huggingface description: Recent advancements in image customization exhibit a wide range of application prospects due to stronger customization capabilities. However, since we humans are more sensitive to faces, a significant challenge remains in preserving consistent identity while avoiding identity confusion with multi-reference images, limiting the identity scalability of customization models. To address this, we present UMO, a Unified Multi-identity Optimization framework, designed to maintain high-fidelity identity preservation and alleviate identity confusion with scalability. With βmulti-to-multi matchingβ paradigm, UMO reformulates multi-identity generation as a global assignment optimization problem and unleashes multi-identity consistency for existing image customization methods generally through reinforcement learning on diffusion models. To facilitate the training of UMO, we develop a scalable customization dataset with multi-reference images, consisting of both synthesised and real parts. Additionally, we propose a new metric to measure identity confusion. Extensive experiments demonstrate that UMO not only improves identity consistency significantly, but also reduces identity confusion on several image customization methods, setting a new state-of-the-art among open-source methods along the dimension of identity preserving. submitted by /u/AgeNo5351 |
I am putting most of my efforts to achieve more realistic Ai acting with natural…
Photonic devices are hardware systems that can process information using light instead of electricity. These…
Model weights: https://huggingface.co/Comfy-Org/Lens PR: https://github.com/Comfy-Org/ComfyUI/pull/14077 You'll need to git the merge pull request if you're…
Link: https://nju-pcalab.github.io/projects/L2P/ submitted by /u/switch2stock [link] [comments]
Keyword search breaks the moment a user types something a document doesn't literally say.
Welcome to The Blueprint, a regular feature where we highlight how Google Cloud customers are…