🚀 Flux-Super-Paint-LoRA模型
Flux-Super-Paint-LoRA是一款文本到图像的模型,借助LoRA技术,能依据特定文本生成风格独特的图像,适用于创意绘画等场景。
🚀 快速开始
环境设置
import torch
from pipelines import DiffusionPipeline
base_model = "black-forest-labs/FLUX.1-dev"
pipe = DiffusionPipeline.from_pretrained(base_model, torch_dtype=torch.bfloat16)
lora_repo = "strangerzonehf/Flux-Super-Paint-LoRA"
trigger_word = "Super Paint"
pipe.load_lora_weights(lora_repo)
device = torch.device("cuda")
pipe.to(device)
触发词使用
你应该使用 Super Paint
来触发图像生成。
模型下载
此模型的权重以Safetensors格式提供。
点击下载,可在 “Files & versions” 标签中获取。
✨ 主要特性
- 文本到图像转换:能够根据输入的文本描述生成对应的图像。
- LoRA技术:基于LoRA技术,提升模型的训练效率和性能。
- 多场景适用:可用于生成抽象画、静物画等多种类型的图像。
📦 安装指南
暂未提供具体安装步骤,可参考上述快速开始部分的代码示例进行环境设置。
💻 使用示例
基础用法
import torch
from pipelines import DiffusionPipeline
base_model = "black-forest-labs/FLUX.1-dev"
pipe = DiffusionPipeline.from_pretrained(base_model, torch_dtype=torch.bfloat16)
lora_repo = "strangerzonehf/Flux-Super-Paint-LoRA"
trigger_word = "Super Paint"
pipe.load_lora_weights(lora_repo)
device = torch.device("cuda")
pipe.to(device)
text = 'Super Paint, An abstract painting of a red basket filled with yellow french fries. The basket is made of red paper, and the basket is attached to a light blue wall. The yellow fries are arranged in a wavy pattern, and there is a yellow letter M on the red paper. There is a shadow of the basket on the left side of the painting, and on the right side, there are black lines that form the letters V and X.'
image = pipe(text).images[0]
image.save("output.png")
📚 详细文档
模型描述

图像示例
文本描述 |
图像 |
'Super Paint, An abstract painting of a red basket filled with yellow french fries. The basket is made of red paper, and the basket is attached to a light blue wall. The yellow fries are arranged in a wavy pattern, and there is a yellow letter M on the red paper. There is a shadow of the basket on the left side of the painting, and on the right side, there are black lines that form the letters V and X.' |
查看 |
'Super Paint, A painting of a glass jar with a green lid. The jar is filled with pickles. The pickles are yellow and green. There is a green stripe on the lid of the jar. There are black letters on the jar that are black. The jars are sitting on a light colored surface. Theres a shadow on the left side of the jars. The wall behind the jar is white.' |
查看 |
'Super Paint, A painting of two cookies on a plate. The cookies are brown with black dots on them. The plate is white with a red stripe on it. There is a white bucket next to the cookies. The bucket has a blue rim around it. The wall behind the bucket is dark blue. The table under the plate is a light green color.' |
查看 |
'Super Paint, An abstract painting of two pieces of bread on a light blue background. The left piece of bread has jam on it, while the right piece has peanut butter on it. The peanut butter is in the shape of a heart. The jam is a vibrant red color, and there are small white dots on the top of the jam. The painting is done in a simple, cartoon style.' |
查看 |
图像参数
参数 |
值 |
参数 |
值 |
LR Scheduler |
constant |
Noise Offset |
0.03 |
Optimizer |
AdamW |
Multires Noise Discount |
0.1 |
Network Dim |
64 |
Multires Noise Iterations |
10 |
Network Alpha |
32 |
Repeat & Steps |
26 & 3400 |
Epoch |
25 |
Save Every N Epochs |
1 |
标注信息
标注方式:florence2-en(自然语言 & 英语)
训练图像数量
总共使用了36张图像进行训练。
最佳尺寸与推理
尺寸 |
纵横比 |
推荐情况 |
1280 x 832 |
3:2 |
最佳 |
1024 x 1024 |
1:1 |
默认 |
推理范围
📄 许可证
本模型使用的许可证为 creativeml-openrail-m
。