đ Flux-Ghibli-Art-LoRA
This is a LoRA model for text-to-image generation, inspired by Ghibli Art. It can generate various Ghibli-style images based on text prompts.
đ Quick Start
Setting Up
import torch
from pipelines import DiffusionPipeline
base_model = "black-forest-labs/FLUX.1-dev"
pipe = DiffusionPipeline.from_pretrained(base_model, torch_dtype=torch.bfloat16)
lora_repo = "strangerzonehf/Flux-Ghibli-Art-LoRA"
trigger_word = "Ghibli Art"
pipe.load_lora_weights(lora_repo)
device = torch.device("cuda")
pipe.to(device)
Trigger words
You should use Ghibli Art to trigger the image generation.
⨠Features
- Text-to-Image Generation: Generate Ghibli-style images based on text prompts.
- Multiple Image Examples: The README provides multiple text prompts and corresponding generated image examples, showing the model's ability to generate different Ghibli-style scenes.
đĻ Installation
The weights for this model are available in Safetensors format.
Download them in the Files & versions tab.
đģ Usage Examples
Basic Usage
Use the provided code in the "Setting Up" section to load the model and generate images. Then, use the trigger word Ghibli Art in your text prompt to generate relevant images.
Advanced Usage
You can adjust the image processing parameters and inference steps according to your needs to get better results. For example, you can change the LR Scheduler, Optimizer, etc. in the image processing parameters table.
đ Documentation
Model description for Flux-Ghibli-Art-LoRA
Image Processing Parameters
| Property |
Details |
| LR Scheduler |
constant |
| Optimizer |
AdamW |
| Network Dim |
64 |
| Network Alpha |
32 |
| Epoch |
15 |
| Noise Offset |
0.03 |
| Multires Noise Discount |
0.1 |
| Multires Noise Iterations |
10 |
| Repeat & Steps |
15 & 2400 |
| Save Every N Epochs |
1 |
Labeling: florence2 - en(natural language & English)
Total Images Used for Training: 20
Best Dimensions & Inference
| Property |
Details |
| Best Dimensions |
1280 x 832 (Aspect Ratio: 3:2) |
| Default Dimensions |
1024 x 1024 (Aspect Ratio: 1:1) |
| Recommended Inference Steps |
30â35 |
Gallery
Here are some examples of generated images:
| Text Prompt |
Output Image |
| 'Ghibli Art, a vibrant orange van is parked on a rocky hillside. The van is adorned with a white roof, adorned with an orange patch, adding a pop of color to the scene. A man in a yellow hooded sweatshirt and jeans is standing on the roof of the van, looking out at the view of the mountain range. The sky is a deep blue, dotted with fluffy white clouds. To the right of the man, a large brown backpack is draped over the vans head. The mountain range is covered in snow, adding to the authenticity of the image.' |
Link |
| 'Ghibli Art, a cartoon-like scene features a young man with short brown hair, dressed in a white t-shirt, brown pants, and brown boots, standing on a cliff overlooking a valley. He is holding a map in his right hand, and a brown backpack on his left shoulder. The valley is filled with lush green trees, and the valley is bordered by a mountain range. The sky is a deep blue, dotted with white clouds, adding a pop of color to the scene.' |
Link |
| 'Ghibli Art, a young boy is riding a bicycle on a wet, rainy day. The boy is dressed in a bright orange shirt, gray pants, and a red backpack. His helmet is black, and he is facing the right side of the frame. The bicycle is casting a shadow on the water, and the water is reflecting the boys reflection. To the left of the boy, a field of yellow corn is growing, and to the right of the field is a house with a red roof. The sky is filled with dark gray clouds, adding a touch of color to the scene.' |
Link |
| 'Ghibli Art, Captured at eye-level on a vibrant day, a man in a blue shirt, and a straw hat is standing in a field of wheat. The man is holding a rifle in his right hand, while his left hand is resting on a wooden fence. In the distance, a brown barn with a brown roof is seen, nestled in the field. The barn is surrounded by trees and a metal tower. The sky is a deep blue, dotted with white clouds, adding a touch of color to the scene.' |
Link |
| 'Ghibli Art: A bustling village square on a sunny afternoon. A boy in a red scarf and green jacket rides a vintage bicycle through the cobblestone streets, carrying a basket full of bread loaves. To his left, a lively market is set up with colorful stalls, while to his right, a fountain with a bronze statue glistens in the sunlight. The sky is a vivid blue with cotton-like clouds, and the buildings are adorned with flowering vines and wooden shutters.' |
Link |
| 'Ghibli Art: A young girl with short black hair and a yellow raincoat stands under a red umbrella in the middle of a cobblestone street. Rain falls steadily, creating ripples in puddles around her feet. Behind her, a small bakery with a warm, glowing light spills onto the street, and its wooden sign sways gently in the wind. The sky is heavy with dark gray clouds, and a single beam of light breaks through, illuminating the scene.' |
Link |
| 'Ghibli Art: A narrow mountain path shrouded in rain and mist. A traveler in a wide-brimmed straw hat and a long green cloak leans on a wooden staff as they walk. Water cascades down the rocky slopes, forming small streams that crisscross the path. The dark clouds above roll ominously, and a single bird soars against the turbulent sky, adding a sense of movement to the stillness.' |
Link |
| 'Ghibli Art: A vibrant spring meadow at dawn. A young woman in a lavender dress and straw hat is painting on an easel under a large cherry blossom tree. Pink petals gently fall around her, and a curious white rabbit sits nearby, watching. The meadow is dotted with yellow and purple wildflowers, and a small brook winds its way through the scene. In the background, a quaint cottage with a stone chimney is nestled among rolling green hills' |
Link |
| 'Ghibli Art: A young boy with tousled black hair sits on a grassy hill under a dark, star-filled sky. He wears a light blue sweater and brown pants, with a small telescope set up in front of him. Around him, fireflies dance in the cool night air, adding a magical glow. A crescent moon hangs low on the horizon, and in the distance, the faint silhouette of a village is visible against the hills.' |
Link |
đ License
The model is under the openrail license.
%20--%3e%3cdefs%3e%3cstyle%3e%20.st0%20{%20fill:%20%23061b40;%20}%20.st1%20{%20fill:%20%23306af1;%20}%20.st2%20{%20fill:%20%235ce5cf;%20}%20%3c/style%3e%3c/defs%3e%3cg%3e%3cpath%20class='st0'%20d='M55,10.5h9v3h-9v9h12V7.5h-12v3ZM64,19.5h-6v-3h6v3Z'/%3e%3cpolygon%20class='st0'%20points='69%2016.5%2078%2016.5%2078%2019.5%2069%2019.5%2069%2022.5%2081%2022.5%2081%2013.5%2072%2013.5%2072%2010.5%2081%2010.5%2081%207.5%2069%207.5%2069%2016.5'/%3e%3cpolygon%20class='st0'%20points='95%2010.5%2095%207.5%2083%207.5%2083%2022.5%2095%2022.5%2095%2019.5%2086%2019.5%2086%2016.5%2095%2016.5%2095%2013.5%2086%2013.5%2086%2010.5%2095%2010.5'/%3e%3cpath%20class='st0'%20d='M40,1.5v21h11.6l1.4-1.4v-7.6h0c0,0-1.4-1.5-1.4-1.5l1.4-1.4V2.9l-1.4-1.4h-11.6ZM50,19.5h-7v-6h7v6ZM50,10.5h-7v-6h7v6Z'/%3e%3c/g%3e%3cpath%20class='st1'%20d='M23.1,24L14.7,4.8l-4.9,11.2h3.8l-1.8,4H3.3L12.1,0H2C.9,0,0,.9,0,2v20c0,1.1.9,2,2,2h21.1Z'/%3e%3cpath%20class='st2'%20d='M34,0h-16.8l10.6,24h6.2c1.1,0,2-.9,2-2V2C36,.9,35.1,0,34,0ZM32.5,20h-4V4h4v16Z'/%3e%3c/svg%3e)
