Infiniteyou

🚀 InfiniteYou Model Card

This repository provides official models for flexible photo recrafting while preserving identity, offering high - quality text - to - image generation.

         

This repository provides the official models for the following paper:

InfiniteYou: Flexible Photo Recrafting While Preserving Your Identity
Liming Jiang, Qing Yan, Yumin Jia, Zichuan Liu, Hao Kang, Xin Lu
ByteDance Intelligent Creation

Abstract: Achieving flexible and high - fidelity identity - preserved image generation remains formidable, particularly with advanced Diffusion Transformers (DiTs) like FLUX. We introduce InfiniteYou (InfU), one of the earliest robust frameworks leveraging DiTs for this task. InfU addresses significant issues of existing methods, such as insufficient identity similarity, poor text - image alignment, and low generation quality and aesthetics. Central to InfU is InfuseNet, a component that injects identity features into the DiT base model via residual connections, enhancing identity similarity while maintaining generation capabilities. A multi - stage training strategy, including pretraining and supervised fine - tuning (SFT) with synthetic single - person - multiple - sample (SPMS) data, further improves text - image alignment, ameliorates image quality, and alleviates face copy - pasting. Extensive experiments demonstrate that InfU achieves state - of - the - art performance, surpassing existing baselines. In addition, the plug - and - play design of InfU ensures compatibility with various existing methods, offering a valuable contribution to the broader community.

🚀 Quick Start

Please clone our GitHub code repository and follow the detailed instructions to install and use the released models for local inference.

We appreciate the GPU grant from the Hugging Face team. You can also try our InfiniteYou - FLUX Hugging Face demo online.

✨ Features

• High - Quality Image Generation: InfU addresses issues of existing methods, such as insufficient identity similarity, poor text - image alignment, and low generation quality and aesthetics.
• Multi - stage Training Strategy: A multi - stage training strategy, including pretraining and supervised fine - tuning (SFT) with synthetic single - person - multiple - sample (SPMS) data, further improves text - image alignment, ameliorates image quality, and alleviates face copy - pasting.
• Plug - and - Play Design: InfU features a desirable plug - and - play design, compatible with many existing methods, providing more controllability and flexibility for customized tasks.

📦 Installation

Please clone our GitHub code repository and follow the detailed instructions to install and use the released models for local inference.

💻 Usage Examples

Basic Usage

We released two model variants of InfiniteYou - FLUX v1.0: aes_stage2 and sim_stage1. The aes_stage2 is our model after stage - 2 SFT, which is used by default for better text - image alignment and aesthetics. If you wish to achieve higher ID similarity, please try sim_stage1.

Advanced Usage

• To better fit specific personal needs, we find that two arguments are highly useful to adjust in our code: --infusenet_conditioning_scale (default: 1.0) and --infusenet_guidance_start (default: 0.0). Usually, you may NOT need to adjust them. If necessary, start by trying a slightly larger --infusenet_guidance_start (e.g., 0.1) only (especially helpful for sim_stage1). If still not satisfactory, then try a slightly smaller --infusenet_conditioning_scale (e.g., 0.9).
• We also provided two LoRAs (Realism and [Anti - blur](https://civitai.com/models/675581/anti - blur - flux - lora)) to enable additional usage flexibility. If needed, try Realism only first. They are entirely optional, which are examples to try but are NOT used in our paper.
• If the generated gender is not preferred, try adding specific words in the text prompt, such as 'a man', 'a woman', etc. We encourage using inclusive and respectful language.

📚 Documentation

Model Zoo

Comparison with State - of - the - Art Relevant Methods

Qualitative comparison results of InfU with the state - of - the - art baselines, FLUX.1 - dev IP - Adapter and PuLID - FLUX. The identity similarity and text - image alignment of the results generated by FLUX.1 - dev IP - Adapter (IPA) are inadequate. PuLID - FLUX generates images with decent identity similarity. However, it suffers from poor text - image alignment (Columns 1, 2, 4), and the image quality (e.g., bad hands in Column 5) and aesthetic appeal are degraded. In addition, the face copy - paste issue of PuLID - FLUX is evident (Column 5). In comparison, the proposed InfU outperforms the baselines across all dimensions.

Plug - and - Play Property with Off - the - Shelf Popular Approaches

InfU features a desirable plug - and - play design, compatible with many existing methods. It naturally supports base model replacement with any variants of FLUX.1 - dev, such as FLUX.1 - schnell for more efficient generation (e.g., in 4 steps). The compatibility with ControlNets and LoRAs provides more controllability and flexibility for customized tasks. Notably, the compatibility with OminiControl extends our potential for multi - concept personalization, such as interacted identity (ID) and object personalized generation. InfU is also compatible with IP - Adapter (IPA) for stylization of personalized images, producing decent results when injecting style references via IPA. Our plug - and - play feature may extend to even more approaches, providing valuable contributions to the broader community.

🔧 Technical Details

InfU is centered around InfuseNet, a component that injects identity features into the DiT base model via residual connections, enhancing identity similarity while maintaining generation capabilities. A multi - stage training strategy, including pretraining and supervised fine - tuning (SFT) with synthetic single - person - multiple - sample (SPMS) data, further improves text - image alignment, ameliorates image quality, and alleviates face copy - pasting.

📄 License

The images used in this repository and related demos are sourced from consented subjects or generated by the models. These pictures are intended solely to showcase the capabilities of our research. If you have any concerns, please feel free to contact us, and we will promptly remove any inappropriate content.

Our model is released under the Creative Commons Attribution - NonCommercial 4.0 International Public License for academic research purposes only. Any manual or automatic downloading of the face models from InsightFace, the [FLUX.1 - dev](https://huggingface.co/black - forest - labs/FLUX.1 - dev) base model, LoRAs (Realism and [Anti - blur](https://civitai.com/models/675581/anti - blur - flux - lora)), etc., must follow their original licenses and be used only for academic research purposes.

This research aims to positively impact the field of Generative AI. Any usage of this method must be responsible and comply with local laws. The developers do not assume any responsibility for any potential misuse.

📖 Citation

If you find InfiniteYou useful for your research or applications, please cite our paper:

@article{jiang2025infiniteyou,
  title={{InfiniteYou}: Flexible Photo Recrafting While Preserving Your Identity},
  author={Jiang, Liming and Yan, Qing and Jia, Yumin and Liu, Zichuan and Kang, Hao and Lu, Xin},
  journal={arXiv preprint},
  volume={arXiv:2503.16418},
  year={2025}
}

We also appreciate it if you could give a star ⭐ to our Github repository. Thanks a lot!