Stable Diffusion FineTuned Zh V2

🚀 Chinese Stable Diffusion Model Card

svjack/Stable-Diffusion-FineTuned-zh-v0 is a latent text-to-image diffusion model specifically designed for Chinese. It can generate images based on any Chinese text input.

This model was trained using the powerful text-to-image model diffusers. For more details about our training method, refer to train_zh_model.py. It also benefits from a good baseline model Taiyi-Stable-Diffusion-1B-Chinese-v0.1 from IDEA-CCNL.

🚀 Quick Start

Installation

Firstly, install our package as follows. This package is a modified version of 🤗's Diffusers library to run Chinese Stable Diffusion.

diffusers==0.6.0
transformers
torch
datasets
accelerate
sentencepiece

Run this command to log in with your HF Hub token if you haven't before:

huggingface-cli login

Usage

Running the pipeline with the LMSDiscreteScheduler scheduler:

from diffusers import StableDiffusionPipeline
pipeline = StableDiffusionPipeline.from_pretrained("svjack/Stable-Diffusion-FineTuned-zh-v2")
pipeline.safety_checker = lambda images, clip_input: (images, False)
pipeline = pipeline.to("cuda")

prompt = '女孩们打开了另一世界的大门'
image = pipeline(prompt, guidance_scale=7.5).images[0]

Generator Results comparison

https://github.com/svjack/Stable-Diffusion-Chinese-Extend

✨ Features

• Chinese-specific: Capable of generating high-quality images based on Chinese text inputs.
• Powered by diffusers: Utilizes the advanced diffusers framework for text-to-image generation.
• Benefits from a good baseline: Trained with the help of Taiyi-Stable-Diffusion-1B-Chinese-v0.1.

📚 Documentation

Model Details

Extra Gated Prompt

One more step before getting this model. This model is open access and available to all, with a CreativeML OpenRAIL-M license further specifying rights and usage. The CreativeML OpenRAIL License specifies:

1. You can't use the model to deliberately produce nor share illegal or harmful outputs or content
2. rinna Co., Ltd. claims no rights on the outputs you generate, you are free to use them and are accountable for their use which must not go against the provisions set in the license
3. You may re-distribute the weights and use the model commercially and/or as a service. If you do, please be aware you have to include the same use restrictions as the ones in the license and share a copy of the CreativeML OpenRAIL-M to all your users (please read the license entirely and carefully) Please read the full license here: https://huggingface.co/spaces/CompVis/stable-diffusion-license

By clicking on "Access repository" below, you accept that your contact information (email address and username) can be shared with the model authors as well.

Extra Gated Fields

I have read the License and agree with its terms: checkbox

📄 License

This model is released under The CreativeML OpenRAIL M license.