🚀 Flux-Super-Paint-LoRA模型
Flux-Super-Paint-LoRA是一款文本到圖像的模型,藉助LoRA技術,能依據特定文本生成風格獨特的圖像,適用於創意繪畫等場景。
🚀 快速開始
環境設置
import torch
from pipelines import DiffusionPipeline
base_model = "black-forest-labs/FLUX.1-dev"
pipe = DiffusionPipeline.from_pretrained(base_model, torch_dtype=torch.bfloat16)
lora_repo = "strangerzonehf/Flux-Super-Paint-LoRA"
trigger_word = "Super Paint"
pipe.load_lora_weights(lora_repo)
device = torch.device("cuda")
pipe.to(device)
觸發詞使用
你應該使用 Super Paint
來觸發圖像生成。
模型下載
此模型的權重以Safetensors格式提供。
點擊下載,可在 “Files & versions” 標籤中獲取。
✨ 主要特性
- 文本到圖像轉換:能夠根據輸入的文本描述生成對應的圖像。
- LoRA技術:基於LoRA技術,提升模型的訓練效率和性能。
- 多場景適用:可用於生成抽象畫、靜物畫等多種類型的圖像。
📦 安裝指南
暫未提供具體安裝步驟,可參考上述快速開始部分的代碼示例進行環境設置。
💻 使用示例
基礎用法
import torch
from pipelines import DiffusionPipeline
base_model = "black-forest-labs/FLUX.1-dev"
pipe = DiffusionPipeline.from_pretrained(base_model, torch_dtype=torch.bfloat16)
lora_repo = "strangerzonehf/Flux-Super-Paint-LoRA"
trigger_word = "Super Paint"
pipe.load_lora_weights(lora_repo)
device = torch.device("cuda")
pipe.to(device)
text = 'Super Paint, An abstract painting of a red basket filled with yellow french fries. The basket is made of red paper, and the basket is attached to a light blue wall. The yellow fries are arranged in a wavy pattern, and there is a yellow letter M on the red paper. There is a shadow of the basket on the left side of the painting, and on the right side, there are black lines that form the letters V and X.'
image = pipe(text).images[0]
image.save("output.png")
📚 詳細文檔
模型描述

圖像示例
文本描述 |
圖像 |
'Super Paint, An abstract painting of a red basket filled with yellow french fries. The basket is made of red paper, and the basket is attached to a light blue wall. The yellow fries are arranged in a wavy pattern, and there is a yellow letter M on the red paper. There is a shadow of the basket on the left side of the painting, and on the right side, there are black lines that form the letters V and X.' |
查看 |
'Super Paint, A painting of a glass jar with a green lid. The jar is filled with pickles. The pickles are yellow and green. There is a green stripe on the lid of the jar. There are black letters on the jar that are black. The jars are sitting on a light colored surface. Theres a shadow on the left side of the jars. The wall behind the jar is white.' |
查看 |
'Super Paint, A painting of two cookies on a plate. The cookies are brown with black dots on them. The plate is white with a red stripe on it. There is a white bucket next to the cookies. The bucket has a blue rim around it. The wall behind the bucket is dark blue. The table under the plate is a light green color.' |
查看 |
'Super Paint, An abstract painting of two pieces of bread on a light blue background. The left piece of bread has jam on it, while the right piece has peanut butter on it. The peanut butter is in the shape of a heart. The jam is a vibrant red color, and there are small white dots on the top of the jam. The painting is done in a simple, cartoon style.' |
查看 |
圖像參數
參數 |
值 |
參數 |
值 |
LR Scheduler |
constant |
Noise Offset |
0.03 |
Optimizer |
AdamW |
Multires Noise Discount |
0.1 |
Network Dim |
64 |
Multires Noise Iterations |
10 |
Network Alpha |
32 |
Repeat & Steps |
26 & 3400 |
Epoch |
25 |
Save Every N Epochs |
1 |
標註信息
標註方式:florence2-en(自然語言 & 英語)
訓練圖像數量
總共使用了36張圖像進行訓練。
最佳尺寸與推理
尺寸 |
縱橫比 |
推薦情況 |
1280 x 832 |
3:2 |
最佳 |
1024 x 1024 |
1:1 |
默認 |
推理範圍
📄 許可證
本模型使用的許可證為 creativeml-openrail-m
。