Flux Controlnet Hed Diffusers

🚀 FLUX.1-dev Hed ControlNet检查点（Diffusers版本）

本仓库提供了由Xlabs AI开发的FLUX.1-dev Hed ControlNet检查点的Diffusers版本，原始仓库 。该项目可用于文本到图像的生成，结合了Diffusers、ControlNet等技术，为图像生成提供了新的解决方案。

🚀 快速开始

本模型可直接与Diffusers库配合使用。以下是使用该模型的示例代码：

import torch
from diffusers.utils import load_image
from diffusers import FluxControlNetModel
from diffusers.pipelines import FluxControlNetPipeline
from PIL import Image
import numpy as np

generator = torch.Generator(device="cuda").manual_seed(87544357)

controlnet = FluxControlNetModel.from_pretrained(
  "Xlabs-AI/flux-controlnet-hed-diffusers",
  torch_dtype=torch.bfloat16,
  use_safetensors=True,
)
pipe = FluxControlNetPipeline.from_pretrained(
  "black-forest-labs/FLUX.1-dev",
  controlnet=controlnet,
  torch_dtype=torch.bfloat16
)
pipe.to("cuda")

control_image = load_image("https://huggingface.co/Xlabs-AI/flux-controlnet-hed-diffusers/resolve/main/hed_example.png")
prompt = "photo of woman in the cyberpank city"

image = pipe(
    prompt,
    control_image=control_image,
    controlnet_conditioning_scale=0.7,
    num_inference_steps=25,
    guidance_scale=3.5,
    height=1376,
    width=1024,
    generator=generator,
    num_images_per_prompt=1,
).images[0]

image.save("output_test_controlnet.png")

📄 许可证

我们的权重遵循 FLUX.1 [dev] 非商业许可证。