Yiwu

🚀 Novelai-Diffusion

Novelai-Diffusion是一款潛在擴散模型，能夠生成高質量的動漫圖像。本項目提供了該模型的diffusers版本，旨在讓所有人都能更便捷地使用Novelai-Diffusion。

🚀 快速開始

這裡提供了一個基於 Gradio 的Web UI和Colab，可用於運行Novelai Diffusion：

在TPU上運行Novelai Diffusion（測試版）：

💻 使用示例

基礎用法

pytorch

from diffusers import DiffusionPipeline
import torch

pipe = DiffusionPipeline.from_pretrained("animelover/novelai-diffusion", custom_pipeline="waifu-research-department/long-prompt-weighting-pipeline", torch_dtype=torch.float16)
pipe.safety_checker = None # we don't need safety checker. you can add not safe words to negative prompt instead.
pipe = pipe.to("cuda")

prompt = "best quality, masterpiece, 1girl, cute, looking at viewer, smiling, open mouth, white hair, red eyes, white kimono, sakura petal"
neg_prompt = "lowres, bad anatomy, error body, error hair, error arm, error hands, bad hands, error fingers, bad  fingers, missing fingers, error legs, bad legs, multiple legs, missing legs, error lighting, error shadow, error reflection, text, error, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry"
# we don't need autocast here, because autocast will make speed slow down.
image = pipe.text2img(prompt,negative_prompt=neg_prompt, width=512,height=768,max_embeddings_multiples=5,guidance_scale=12).images[0]
image.save("test.png")

onnxruntime

from diffusers import DiffusionPipeline

pipe = DiffusionPipeline.from_pretrained("animelover/novelai-diffusion", revision="onnx16",
                                         custom_pipeline="waifu-research-department/onnx-long-prompt-weighting-pipeline",
                                         provider="CUDAExecutionProvider")
pipe.safety_checker = None # we don't need safety checker. you can add not safe words to negative prompt instead.

prompt = "best quality, masterpiece, 1girl, cute, looking at viewer, smiling, open mouth, white hair, red eyes, white kimono, sakura petal"
neg_prompt = "lowres, bad anatomy, error body, error hair, error arm, error hands, bad hands, error fingers, bad  fingers, missing fingers, error legs, bad legs, multiple legs, missing legs, error lighting, error shadow, error reflection, text, error, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry"
image = pipe.text2img(prompt,negative_prompt=neg_prompt, width=512,height=768,max_embeddings_multiples=5,guidance_scale=12).images[0]
image.save("test.png")

⚠️ 重要提示

我們可以使用 "waifu-research-department/long-prompt-weighting-pipeline" 輸入長提示並調整權重，這需要 diffusers >= 0.4.0。

📄 許可證

許可證信息未知。

📚 致謝

感謝 novelai 提供瞭如此出色的模型。如果可以，請支持他們。