flux.1-schnell-pvc-style-lora Open-Source Model - Freely Generate Anime Character Images in PVC Figure Style

Flux.1 Schnell Pvc Style Lora

Developed by p1atdev

LoRA adapter trained on the FLUX.1-schnell base model, specifically designed for generating PVC figure-style anime character images

Image Generation Open Source License:Apache-2.0 #PVC figure style generation #Chibi Nendoroid adaptation #FLUX framework optimization

Downloads 162

Release Time : 8/20/2024

Model Overview

This model adapts the FLUX.1-schnell base model using LoRA technology to generate high-quality PVC figure-style images from text descriptions, particularly suitable for anime character creation.

Model Features

PVC figure style generation

Specially optimized for generating anime character images in PVC figure, Chibi Nendoroid, and figma action figure styles

LoRA technology adaptation

Employs LoRA (Low-Rank Adaptation) technology for lightweight adaptation of the base model, maintaining high-quality output while reducing computational resource requirements

Trigger word control

Supports precise style control through specific trigger words (e.g., 'PVC figure', 'Chibi Nendoroid')

Model Capabilities

Anime character generation

PVC figure style conversion

Chibi character generation

Text-based image generation

Use Cases

Anime creation

Character concept design

Quickly generate PVC figure-style concept art for anime characters

Sample images showcase anime characters in various styles and poses

Merchandise design

Generate design prototypes for figures, Nendoroids, and other merchandise

Can produce standardized character images suitable for commercial production

🚀 FLUX.1 schnell PVC style

This is a LoRA model in PVC figure style for FLUX.1-schnell. It can generate various high - quality text - to - image results.

🚀 Quick Start

✨ Features

This is a PVC figure style LoRA for FLUX.1-schnell.
Trained on FLUX.1-schnell with the training adapter using ostris/ai-toolkit.

📦 Installation

No installation steps are provided in the original README, so this section is skipped.

💻 Usage Examples

Basic Usage

You can use the following trigger words to generate images:

You should use pvc figure to trigger the image generation.
You should use nendoroid to trigger the image generation.
You should use figma to trigger the image generation.

Here are some example prompts and their corresponding output image URLs:

Prompt	Output Image URL
1girl is standing leftside by a blackboard rightside. pvc style. from front shot, 1girl; 1girl, nendoroid, blue hair, medium hair, cat ears, looking at viewer, white dress shirt, black shorts, arm up, open mouth, chibi. blackboard; blackboard with wooden frame and feet, text of "schnell LoRA workflow" on the board.	images/flux_lora_00221_.png
1girl, solo, full body, gloves, groin, hair between eyes, hair ornament, head tilt, holding, holding staff, horns, long hair, looking at viewer, maid headdress, mole, mole under eye, navel, parted lips, purple eyes, purple hair, purple theme, shawl, shorts, single horn, staff, standing, thighhighs, twintails, white footwear, white gloves, white thighhighs	images/flux_lora_00222_.png
1girl, solo, blue hair, cat ears, parted bangs, long hair, looking at viewer, white dress shirt, rainy, sitting	images/flux_lora_00223_.png
cute anime girl with massive fluffy fennec ears and a big fluffy tail blonde messy long hair blue eyes wearing a maid outfit with a long black gold leaf pattern dress and a white apron mouth open placing a fancy black forest cake with candles on top of a dinner table of an old dark Victorian mansion lit by candlelight with a bright window to the foggy forest and very expensive stuff everywhere there are paintings on the walls	images/flux_lora_00224_.png
1girl, solo, maid, cowboy shot, cup, green eyes, green hair, hair intakes, hair ornament, holding, holding cup, lips, long hair, looking at viewer, ponytail, realistic, simple background, teacup, very long hair, white background, wrist cuffs	images/flux_lora_00227_.png
1girl, hatsune miku, vocaloid, solo, :o, bare shoulders, black skirt, black sleeves, black thighhighs, blue eyes, blue hair, blush, collared shirt, detached sleeves, hair ornament, kneeling, long hair, long sleeves, looking at viewer, miniskirt, parted lips, pleated skirt, shirt, skirt, sleeveless, sleeveless shirt, thighhighs, twintails, very long hair, white shirt, wing collar	images/flux_lora_00229_.png
1girl, solo, outdoors, looking at viewer, flower, gloves, grey hair, hat, jacket, long hair, long skirt, long sleeves, looking at viewer, open clothes, open jacket, pantyhose, red eyes, red flower, red hat, red jacket, red rose, red skirt, rose, shirt, skirt, smile, snowing, standing, white gloves, white shirt	images/flux_lora_00247_.png

📚 Documentation

Prompt guide

This LoRA was trained with danbooru tags, but maybe not all danbooru tags will work. Please consider to use natural language to align.

🔧 Technical Details

Training config

WandB log: https://wandb.ai/p1atdev/flux_lora_pvc_schnell_1

TL;DR:

learning_rate 1e - 4 for constant with AdamW8bit (default)
used about 2500 images
batch_size 4, gradient_accumulation_steps 1
- took about 32GB VRAM
LoRA config (default)
- linear: 16
- linear_alpha: 16
base model: black-forest-labs/FLUX.1-schnell
assistant lora: ostris/FLUX.1-schnell-training-adapter
trained for 10,000 steps but finally used the merge of checkpoint at 7250 and 7500 for 1:1.
GPU: A6000 x1 (VRAM 48GB)

Full config.yaml

job: extension
config:
  name: flux_lora_pvc_schnell_1
  process:
  - type: sd_trainer
    training_folder: output
    device: cuda:3
    network:
      type: lora
      linear: 16
      linear_alpha: 16
    save:
      dtype: bfloat16
      save_every: 250
      max_step_saves_to_keep: 10
    datasets:
    - folder_path: /workspace/ai-toolkit/dataset/pvc
      caption_ext: txt
      caption_dropout_rate: 0.01
      shuffle_tokens: true
      cache_latents_to_disk: true
      resolution:
      - 768
      - 1024
    train:
      batch_size: 4
      steps: 10000
      gradient_accumulation_steps: 1
      train_unet: true
      train_text_encoder: false
      gradient_checkpointing: true
      noise_scheduler: flowmatch
      optimizer: adamw8bit
      lr: 0.0001
      ema_config:
        use_ema: true
        ema_decay: 0.99
      dtype: bf16
    model:
      name_or_path: black-forest-labs/FLUX.1-schnell
      assistant_lora_path: ostris/FLUX.1-schnell-training-adapter
      is_flux: true
      quantize: true
    sample:
      sampler: flowmatch
      sample_every: 250
      width: 832
      height: 1152
      prompts:
      - 1girl, solo, blue hair, cat ears, parted bangs, long hair, looking at viewer,
        white dress shirt, rainy, wariza, sitting
      - 1girl, solo, full body, gloves, groin, hair between eyes, hair ornament, head
        tilt, holding, holding staff, horns, long hair, looking at viewer, maid headdress,
        mole, mole under eye, navel, parted lips, purple eyes, purple hair, purple
        theme, shawl, shorts, single horn, staff, standing, thighhighs, twintails,
        white footwear, white gloves, white thighhighs
      - 1girl, aqua eyes, baseball cap, blonde hair, closed mouth, earrings, green
        background, hat, hoop earrings, jewelry, looking at viewer, shirt, short hair,
        solo, upper body, yellow shirt,
      - 1girl, bangs, bare shoulders, beret, black hair, black shorts, blue hair,
        bracelet, breasts, buttons, colored inner hair, double-breasted, eyewear removed,
        green headwear, green jacket, grey eyes, grey sky, hat, jacket, jewelry, long
        hair, looking at viewer, multicolored hair, neck ring, o-ring, off shoulder,
        rain, round eyewear, shorts, sidelocks, small breasts, solo, sunglasses, wavy
        hair, wet, zipper,
      - 1girl, brown hair, green eyes, colorful, autumn, cumulonimbus clouds, lighting,
        blue sky, falling leaves, garden
      - 1girl, bangs, black wings, blush, choker, collarbone, feathered wings, hair
        between eyes, halo, hand on hip, hat, head wings, long hair, long sleeves,
        looking at viewer, pink eyes, pink hair, pleated skirt, school hat, school
        uniform, serafuku, sidelocks, simple background, skirt, solo, twintails, wavy
        mouth, white background, wings, waifu,
      neg: ''
      seed: 42
      walk_seed: true
      guidance_scale: 1
      sample_steps: 4
    logging:
      use_wandb: true
      project_name: flux_lora_pvc_schnell_1
      run_name: run-1
meta:
  name: flux_lora_schnell_pvc
  version: '1.0'

📄 License

This model is licensed under apache - 2.0.

Featured Recommended AI Models

Empowering the Future, Your AI Solution Knowledge Base

English 简体中文繁體中文にほんご