| | https://huggingface.co/bytedance-research/UMO Bytedance have released 3 days ago their image editing/creation model UMO. From their huggingface description: Recent advancements in image customization exhibit a wide range of application prospects due to stronger customization capabilities. However, since we humans are more sensitive to faces, a significant challenge remains in preserving consistent identity while avoiding identity confusion with multi-reference images, limiting the identity scalability of customization models. To address this, we present UMO, a Unified Multi-identity Optimization framework, designed to maintain high-fidelity identity preservation and alleviate identity confusion with scalability. With βmulti-to-multi matchingβ paradigm, UMO reformulates multi-identity generation as a global assignment optimization problem and unleashes multi-identity consistency for existing image customization methods generally through reinforcement learning on diffusion models. To facilitate the training of UMO, we develop a scalable customization dataset with multi-reference images, consisting of both synthesised and real parts. Additionally, we propose a new metric to measure identity confusion. Extensive experiments demonstrate that UMO not only improves identity consistency significantly, but also reduces identity confusion on several image customization methods, setting a new state-of-the-art among open-source methods along the dimension of identity preserving. submitted by /u/AgeNo5351 |
We've pushed an LTX-2.3 update today. The Distilled model has been retrained (now v1.1) with…
The open-weights model ecosystem shifted recently with the release of the
Language models (LMs), at their core, are text-in and text-out systems.
This paper was accepted at the Workshop on Navigating and Addressing Data Problems for Foundation…
Building effective reward functions can help you customize Amazon Nova models to your specific needs,…
At Google Cloud, we often see customers asking themselves: "How can we manage our generative…