Catvton Flux Beta

🚀 CATVTON-Flux

CATVTON-Flux is an advanced virtual try-on solution that combines CATVTON with a Flux fill inpainting model for realistic and accurate clothing transfer.

🚀 Quick Start

transformer = FluxTransformer2DModel.from_pretrained(
    "xiaozaa/catvton-flux-beta", 
    torch_dtype=torch.bfloat16
)
pipe = FluxFillPipeline.from_pretrained(
    "black-forest-labs/FLUX.1-dev",
    transformer=transformer,
    torch_dtype=torch.bfloat16
).to("cuda")

✨ Features

CATVTON-Flux combines CATVTON (Contrastive Appearance and Topology Virtual Try-On) with a Flux fill inpainting model, providing a realistic and accurate virtual try - on solution.

📚 Documentation

Model Details

Model Description

• Developed by: X/Twitter:Black Magic An

Model Sources

• Repository: github

Uses

The model is designed for virtual try - on applications. It enables users to visualize how different garments would look on a person. It can be used directly through the command - line interface with the following parameters:

• Input person image
• Person mask
• Garment image
• Random seed (optional)

Training Details

Training Data

dresscode dataset

Training Procedure

Finetuning Flux1 - dev - fill

Evaluation

Results

[More Information Needed]

Summary

BibTeX:

@misc{chong2024catvtonconcatenationneedvirtual,
 title={CatVTON: Concatenation Is All You Need for Virtual Try-On with Diffusion Models}, 
 author={Zheng Chong and Xiao Dong and Haoxiang Li and Shiyue Zhang and Wenqing Zhang and Xujie Zhang and Hanqing Zhao and Xiaodan Liang},
 year={2024},
 eprint={2407.15886},
 archivePrefix={arXiv},
 primaryClass={cs.CV},
 url={https://arxiv.org/abs/2407.15886}, 
}
@article{lhhuang2024iclora,
  title={In-Context LoRA for Diffusion Transformers},
  author={Huang, Lianghua and Wang, Wei and Wu, Zhi-Fan and Shi, Yupeng and Dou, Huanzhang and Liang, Chen and Feng, Yutong and Liu, Yu and Zhou, Jingren},
  journal={arXiv preprint arxiv:2410.23775},
  year={2024}
}

📄 License

cc - by - nc - 2.0