FLUX.1 Dev LoRA Makoto Shinkai

🚀 FLUX.1-dev-LoRA-Makoto-Shinkai

This project provides a LoRA model in the style of Makoto Shinkai, trained on the FLUX.1-dev base model. It enables users to generate images with the distinct aesthetic of Makoto Shinkai's works.

🚀 Quick Start

✨ Features

• Text-to-Image Generation: Generate high - quality images based on text prompts in the Makoto Shinkai style.
• LoRA Integration: Utilize the LoRA model to fine - tune the base FLUX.1 - dev model for specific style generation.

📦 Installation

No specific installation steps are provided in the original document.

💻 Usage Examples

Basic Usage

You should use Makoto Shinkai style to trigger the image generation.

import torch
from diffusers import FluxPipeline

pipe = FluxPipeline.from_pretrained("black-forest-labs/FLUX.1-dev", torch_dtype=torch.bfloat16)
pipe.load_lora_weights("InstantX/FLUX.1-dev-LoRA-Makoto-Shinkai", weight_name="Makoto_Shinkai_style.safetensors")
pipe.fuse_lora(lora_scale=1.0)
pipe.to("cuda")

prompt = "Makoto Shinkai style, a shepherd boy floating on a wooly cloud-whale, holding a glowing dandelion staff to guide sheep-shaped cumulus, miniature storm clouds grazing nearby, his patched jacket flapping in high-altitude winds, aurora-like ribbons in peach and lavender stretching across the sky"

image = pipe(prompt, 
             num_inference_steps=24, 
             guidance_scale=3.5,
             width=960, height=1280,
            ).images[0]
image.save(f"example.png")

📚 Documentation

Trigger words

You should use Makoto Shinkai style to trigger the image generation.

📄 License

This project uses the flux-1-dev-non-commercial-license. You can view the full license details here.

Gallery

Here are some examples of generated images:

• Prompt: Makoto Shinkai style, a boy and a girl looking out of a window with a cat perched on the window sill. There is a bicycle parked in front of them and a plant with flowers to the right side of the image. The wall behind them is visible in the background.
  • Output: View Image
• Prompt: Makoto Shinkai style, a girl in a green cloak walking alone through an ancient forest, sunlight piercing through towering trees like stained glass, glowing pollen swirling around her boots, a rusted lantern hanging from her wooden staff, shadows of deer spirits flickering between moss - covered stones, muted emerald and gold color palette
  • Output: View Image
• Prompt: Makoto Shinkai style, a shepherd boy floating on a wooly cloud - whale, holding a glowing dandelion staff to guide sheep - shaped cumulus, miniature storm clouds grazing nearby, his patched jacket flapping in high - altitude winds, aurora - like ribbons in peach and lavender stretching across the sky
  • Output: View Image

Model Information