Proteusv0.2

🚀 ProteusV0.2

ProteusV0.2 is an enhanced text - to - image model. It addresses the issues of understanding anime or cartoon - related tags by merging with RealCartoonXL. It shows significant improvements in prompt understanding and stylistic capabilities compared to previous versions.

🚀 Quick Start

Try Online

You can try out the model with the following text prompts and view the generated images:

Use it with 🧨 diffusers

import torch
from diffusers import (
    StableDiffusionXLPipeline, 
    KDPM2AncestralDiscreteScheduler,
    AutoencoderKL
)

# Load VAE component
vae = AutoencoderKL.from_pretrained(
    "madebyollin/sdxl-vae-fp16-fix", 
    torch_dtype=torch.float16
)

# Configure the pipeline
pipe = StableDiffusionXLPipeline.from_pretrained(
    "dataautogpt3/ProteusV0.2", 
    vae=vae,
    torch_dtype=torch.float16
)
pipe.scheduler = KDPM2AncestralDiscreteScheduler.from_config(pipe.scheduler.config)
pipe.to('cuda')

# Define prompts and generate image
prompt = "black fluffy gorgeous dangerous cat animal creature, large orange eyes, big fluffy ears, piercing gaze, full moon, dark ambiance, best quality, extremely detailed"
negative_prompt = "nsfw, bad quality, bad anatomy, worst quality, low quality, low resolutions, extra fingers, blur, blurry, ugly, wrongs proportions, watermark, image artifacts, lowres, ugly, jpeg artifacts, deformed, noisy image"

image = pipe(
    prompt, 
    negative_prompt=negative_prompt, 
    width=1024,
    height=1024,
    guidance_scale=7.5,
    num_inference_steps=50
).images[0]

✨ Features

• Enhanced Prompt Understanding: ProteusV0.2 shows subtle yet significant improvements over Version 0.1. It surpasses MJ6 in prompt understanding and approaches its stylistic capabilities.
• Improved Aesthetic Domains: It can better portray intricate facial characteristics and lifelike skin textures while maintaining good proficiency in various aesthetic domains, such as surrealism, anime, and cartoon - style visualizations.

📦 Installation

No specific installation steps are provided in the original README. If you want to use it with 🧨 diffusers, make sure you have the necessary Python libraries installed, such as torch and diffusers.

📚 Documentation

Proteus

Proteus is a sophisticated enhancement over OpenDalleV1.1. It leverages the core functionalities of OpenDalleV1.1 to deliver superior outcomes. Key areas of advancement include:

• Prompt Responsiveness: It has heightened responsiveness to prompts.
• Creative Capacities: It has augmented creative capacities.

To achieve these improvements, it was fine - tuned using approximately 220,000 GPTV captioned images from copyright - free stock images (with some anime included), which were then normalized. Additionally, DPO (Direct Preference Optimization) was employed through a collection of 10,000 carefully selected high - quality, AI - generated image pairs.

Settings for ProteusV0.2

Use these settings for the best results with ProteusV0.2:

• CFG Scale: Use a CFG scale of 8 to 7.
• Steps: 20 to 60 steps for more detail, 20 steps for faster results.
• Sampler: DPM++ 2M SDE
• Scheduler: Karras
• Resolution: 1280x1280 or 1024x1024

Please also consider using these keep words to improve your prompts: best quality, HD, ~*~aesthetic~*~.

If you are having trouble coming up with prompts, you can use this GPT to help you refine the prompt: [https://chat.openai.com/g/g - RziQNoydR - diffusion - master](https://chat.openai.com/g/g - RziQNoydR - diffusion - master)

📄 License

This project is licensed under the GPL - 3.0 license.

💡 Usage Tip

If you want to support the development of this project, you can donate on https://www.buymeacoffee.com/DataVoid or follow the author on https://twitter.com/DataPlusEngine.