flux.1-schnell-pvc-style-lora开源模型 - 免费生成PVC手办风格动漫角色图像

首页

Flux.1 Schnell Pvc Style Lora

由 p1atdev 开发

基于FLUX.1-schnell基础模型训练的LoRA适配器，专门用于生成PVC手办风格的动漫角色图像

图像生成开源协议:Apache-2.0 #PVC手办风格生成 #Q版黏土人适配 #FLUX框架优化

下载量 162

发布时间 : 8/20/2024

模型简介

该模型通过LoRA技术适配FLUX.1-schnell基础模型，能够根据文本描述生成高质量的PVC手办风格图像，特别适合动漫角色创作。

模型特点

PVC手办风格生成

专门优化用于生成PVC手办、Q版黏土人和figma可动模型风格的动漫角色图像

LoRA技术适配

采用LoRA（Low-Rank Adaptation）技术对基础模型进行轻量级适配，保持高质量输出的同时减少计算资源需求

触发词控制

支持通过特定触发词（如'pvc手办'、'Q版黏土人'）精确控制生成风格

模型能力

动漫角色生成

PVC手办风格转换

Q版角色生成

基于文本描述的图像生成

使用案例

动漫创作

角色概念设计

快速生成动漫角色的PVC手办风格概念图

示例图片展示了不同风格和姿势的动漫角色

周边产品设计

为手办、黏土人等周边产品生成设计原型

可生成适合商业生产的标准化角色图像

🚀 FLUX.1 schnell PVC风格

这是一个基于文本生成图像的项目，利用LoRA技术，基于diffusers库实现。该项目可以根据输入的文本描述生成具有PVC风格的图像。

示例展示

以下是一些输入文本及其对应的生成图像示例：

输入文本	输出图像
1girl is standing leftside by a blackboard rightside. pvc style. from front shot, 1girl; 1girl, nendoroid, blue hair, medium hair, cat ears, looking at viewer, white dress shirt, black shorts, arm up, open mouth, chibi. blackboard; blackboard with wooden frame and feet, text of "schnell LoRA workflow" on the board.	点击查看
1girl, solo, full body, gloves, groin, hair between eyes, hair ornament, head tilt, holding, holding staff, horns, long hair, looking at viewer, maid headdress, mole, mole under eye, navel, parted lips, purple eyes, purple hair, purple theme, shawl, shorts, single horn, staff, standing, thighhighs, twintails, white footwear, white gloves, white thighhighs	点击查看
1girl, solo, blue hair, cat ears, parted bangs, long hair, looking at viewer, white dress shirt, rainy, sitting	点击查看
cute anime girl with massive fluffy fennec ears and a big fluffy tail blonde messy long hair blue eyes wearing a maid outfit with a long black gold leaf pattern dress and a white apron mouth open placing a fancy black forest cake with candles on top of a dinner table of an old dark Victorian mansion lit by candlelight with a bright window to the foggy forest and very expensive stuff everywhere there are paintings on the walls	点击查看
1girl, solo, maid, cowboy shot, cup, green eyes, green hair, hair intakes, hair ornament, holding, holding cup, lips, long hair, looking at viewer, ponytail, realistic, simple background, teacup, very long hair, white background, wrist cuffs	点击查看
1girl, hatsune miku, vocaloid, solo, :o, bare shoulders, black skirt, black sleeves, black thighhighs, blue eyes, blue hair, blush, collared shirt, detached sleeves, hair ornament, kneeling, long hair, long sleeves, looking at viewer, miniskirt, parted lips, pleated skirt, shirt, skirt, sleeveless, sleeveless shirt, thighhighs, twintails, very long hair, white shirt, wing collar	点击查看
1girl, solo, outdoors, looking at viewer, flower, gloves, grey hair, hat, jacket, long hair, long skirt, long sleeves, looking at viewer, open clothes, open jacket, pantyhose, red eyes, red flower, red hat, red jacket, red rose, red skirt, rose, shirt, skirt, smile, snowing, standing, white gloves, white shirt	点击查看

✨ 主要特性

文本生成图像：根据输入的文本描述生成具有PVC风格的图像。
LoRA技术：利用低秩自适应（LoRA）技术进行模型训练，提高训练效率。
基于diffusers库：使用diffusers库实现图像生成功能。

📦 安装指南

文档中未提及具体安装步骤，故跳过此章节。

💻 使用示例

触发词使用

你可以使用以下触发词来触发图像生成：

pvc figure
nendoroid
figma

提示指南

此LoRA模型使用danbooru标签进行训练，但并非所有danbooru标签都能生效。建议使用自然语言进行输入。

📚 详细文档

模型描述

这是一个用于FLUX.1-schnell的PVC风格LoRA模型。它基于FLUX.1-schnell模型，使用训练适配器和ostris/ai-toolkit进行训练。

下载模型

该模型的权重以Safetensors格式提供。你可以在文件与版本标签中下载。

训练配置

WandB日志：点击查看
简要配置：
- learning_rate：1e-4，采用constant策略，使用AdamW8bit优化器（默认）
- 约使用2500张图像进行训练
- batch_size：4，gradient_accumulation_steps：1，约需32GB显存
- LoRA配置（默认）：
  - linear：16
  - linear_alpha：16
- 基础模型：black-forest-labs/FLUX.1-schnell
- 辅助LoRA模型：ostris/FLUX.1-schnell-training-adapter
- 训练步数：10,000步，最终使用第7250步和第7500步的检查点以1:1的比例合并
- GPU：A6000 x1（显存48GB）

完整的config.yaml文件

job: extension
config:
  name: flux_lora_pvc_schnell_1
  process:
  - type: sd_trainer
    training_folder: output
    device: cuda:3
    network:
      type: lora
      linear: 16
      linear_alpha: 16
    save:
      dtype: bfloat16
      save_every: 250
      max_step_saves_to_keep: 10
    datasets:
    - folder_path: /workspace/ai-toolkit/dataset/pvc
      caption_ext: txt
      caption_dropout_rate: 0.01
      shuffle_tokens: true
      cache_latents_to_disk: true
      resolution:
      - 768
      - 1024
    train:
      batch_size: 4
      steps: 10000
      gradient_accumulation_steps: 1
      train_unet: true
      train_text_encoder: false
      gradient_checkpointing: true
      noise_scheduler: flowmatch
      optimizer: adamw8bit
      lr: 0.0001
      ema_config:
        use_ema: true
        ema_decay: 0.99
      dtype: bf16
    model:
      name_or_path: black-forest-labs/FLUX.1-schnell
      assistant_lora_path: ostris/FLUX.1-schnell-training-adapter
      is_flux: true
      quantize: true
    sample:
      sampler: flowmatch
      sample_every: 250
      width: 832
      height: 1152
      prompts:
      - 1girl, solo, blue hair, cat ears, parted bangs, long hair, looking at viewer,
        white dress shirt, rainy, wariza, sitting
      - 1girl, solo, full body, gloves, groin, hair between eyes, hair ornament, head
        tilt, holding, holding staff, horns, long hair, looking at viewer, maid headdress,
        mole, mole under eye, navel, parted lips, purple eyes, purple hair, purple
        theme, shawl, shorts, single horn, staff, standing, thighhighs, twintails,
        white footwear, white gloves, white thighhighs
      - 1girl, aqua eyes, baseball cap, blonde hair, closed mouth, earrings, green
        background, hat, hoop earrings, jewelry, looking at viewer, shirt, short hair,
        solo, upper body, yellow shirt,
      - 1girl, bangs, bare shoulders, beret, black hair, black shorts, blue hair,
        bracelet, breasts, buttons, colored inner hair, double-breasted, eyewear removed,
        green headwear, green jacket, grey eyes, grey sky, hat, jacket, jewelry, long
        hair, looking at viewer, multicolored hair, neck ring, o-ring, off shoulder,
        rain, round eyewear, shorts, sidelocks, small breasts, solo, sunglasses, wavy
        hair, wet, zipper,
      - 1girl, brown hair, green eyes, colorful, autumn, cumulonimbus clouds, lighting,
        blue sky, falling leaves, garden
      - 1girl, bangs, black wings, blush, choker, collarbone, feathered wings, hair
        between eyes, halo, hand on hip, hat, head wings, long hair, long sleeves,
        looking at viewer, pink eyes, pink hair, pleated skirt, school hat, school
        uniform, serafuku, sidelocks, simple background, skirt, solo, twintails, wavy
        mouth, white background, wings, waifu,
      neg: ''
      seed: 42
      walk_seed: true
      guidance_scale: 1
      sample_steps: 4
    logging:
      use_wandb: true
      project_name: flux_lora_pvc_schnell_1
      run_name: run-1
meta:
  name: flux_lora_schnell_pvc
  version: '1.0'