đ IP-Adapter Checkpoint for FLUX.1-dev
This repository offers an IP-Adapter checkpoint for the FLUX.1-dev model developed by Black Forest Labs. It focuses on text-to-image generation, leveraging technologies like Stable Diffusion, Flux, diffusers, and ControlNet.
See our github for comfy ui workflows.
đ Quick Start
Inference Options
To try our models, you have two options:
- Use
main.py from our official repo.
- Use our custom nodes for ComfyUI and test it with provided workflows (check out folder
/workflows).
Instruction for ComfyUI
- Go to
ComfyUI/custom_nodes.
- Clone x-flux-comfyui, and the path should be
ComfyUI/custom_nodes/x-flux-comfyui/*, where * represents all the files in this repo.
- Go to
ComfyUI/custom_nodes/x-flux-comfyui/ and run python setup.py.
- Update
x-flux-comfy with git pull or reinstall it.
- Download Clip-L
model.safetensors from OpenAI VIT CLIP large, and put it to ComfyUI/models/clip_vision/*.
- Download our IPAdapter from huggingface, and put it to
ComfyUI/models/xlabs/ipadapters/*.
- Use
Flux Load IPAdapter and Apply Flux IPAdapter nodes, choose the right CLIP model and enjoy your generations.
- You can find an example workflow in the
workflows folder in this repo.
â ī¸ Important Note
The IP Adapter is currently in beta. We do not guarantee that you will get a good result right away, it may take more attempts to get a result.
đĄ Usage Tip
If you get bad results, try to set true_gs=2.
⨠Features
- Multiple Resolutions Support: IP-Adapter is trained on 512x512 resolution for 50k steps and 1024x1024 for 25k steps resolution and works for both 512x512 and 1024x1024 resolution.
- Regular Updates: The model is under training, and we release new checkpoints regularly.
- ComfyUI Compatibility: We release the v1 version which can be used directly in ComfyUI.
đĻ Installation
Please, see our ComfyUI custom nodes installation guide
đģ Usage Examples
Examples of Model Results
See examples of our models results below. Also, some generation results with input images are provided in "Files and versions".
đ Documentation
Models
IP-Adapter is trained on different resolutions and works for both 512x512 and 1024x1024 resolution. The model is still in the training process, and we release new checkpoints regularly. We have released the v1 version which can be used directly in ComfyUI.
đ License
Our weights fall under the FLUX.1 [dev] Non-Commercial License.
| Property |
Details |
| Model Type |
IP-Adapter checkpoint for FLUX.1-dev model |
| Training Data |
Not specified |
| License |
FLUX.1 [dev] Non-Commercial License |
| New Version |
XLabs-AI/flux-ip-adapter-v2 |
%20--%3e%3cdefs%3e%3cstyle%3e%20.st0%20{%20fill:%20%23061b40;%20}%20.st1%20{%20fill:%20%23306af1;%20}%20.st2%20{%20fill:%20%235ce5cf;%20}%20%3c/style%3e%3c/defs%3e%3cg%3e%3cpath%20class='st0'%20d='M55,10.5h9v3h-9v9h12V7.5h-12v3ZM64,19.5h-6v-3h6v3Z'/%3e%3cpolygon%20class='st0'%20points='69%2016.5%2078%2016.5%2078%2019.5%2069%2019.5%2069%2022.5%2081%2022.5%2081%2013.5%2072%2013.5%2072%2010.5%2081%2010.5%2081%207.5%2069%207.5%2069%2016.5'/%3e%3cpolygon%20class='st0'%20points='95%2010.5%2095%207.5%2083%207.5%2083%2022.5%2095%2022.5%2095%2019.5%2086%2019.5%2086%2016.5%2095%2016.5%2095%2013.5%2086%2013.5%2086%2010.5%2095%2010.5'/%3e%3cpath%20class='st0'%20d='M40,1.5v21h11.6l1.4-1.4v-7.6h0c0,0-1.4-1.5-1.4-1.5l1.4-1.4V2.9l-1.4-1.4h-11.6ZM50,19.5h-7v-6h7v6ZM50,10.5h-7v-6h7v6Z'/%3e%3c/g%3e%3cpath%20class='st1'%20d='M23.1,24L14.7,4.8l-4.9,11.2h3.8l-1.8,4H3.3L12.1,0H2C.9,0,0,.9,0,2v20c0,1.1.9,2,2,2h21.1Z'/%3e%3cpath%20class='st2'%20d='M34,0h-16.8l10.6,24h6.2c1.1,0,2-.9,2-2V2C36,.9,35.1,0,34,0ZM32.5,20h-4V4h4v16Z'/%3e%3c/svg%3e)