Dungeons-and-Diffusion Open-Source Model - Free to Generate Diverse D&D Fantasy Characters with High-Resolution and Excellent Results

Dungeons And Diffusion

Developed by 0xJustin

A D&D character generation model fine-tuned based on Protogen, supporting various fantasy races and classes with excellent generation results, especially outstanding at resolutions above 512x512.

Image Generation Open Source License:Openrail #D&D character generation #High-resolution optimization #Multi-race support

Downloads 278

Release Time : 11/6/2022

Model Overview

This model focuses on generating Dungeons & Dragons (D&D) style character images, supporting various fantasy races and classes, suitable for game character design, concept art creation, and other scenarios.

Model Features

Diverse race support

Supports 28 fantasy races including Aarakocra, Aasimar, Dragonborn, etc., meeting various D&D character design needs.

Rich class selection

Includes 15 classes such as Artificer, Bard, Barbarian, etc., capable of generating characters with distinct class features.

Excellent high-resolution performance

Significantly improved generation quality at resolutions above 512x512, suitable for high-quality image output.

Varied art styles

Supports multiple art style prompts, capable of generating character images ranging from realistic to cartoon styles.

Model Capabilities

Generate D&D style character images

Support for multiple fantasy races

Support for multiple class features

High-resolution image generation

Art style control

Use Cases

Game development

Character concept design

Quickly generate D&D style character concept art for games

Generate complete character images with racial and class features

NPC design

Batch generate non-player character images for games

Diverse NPC appearances to enhance game world richness

Art creation

Fantasy art creation

Provide inspiration sources for illustrations or concept art

Generate fantasy character images with artistic value

Character commission reference

Provide preliminary visual references for character commissions

Quickly generate preview images close to the final commissioned style

🚀 D&Diffusion3.0

D&Diffusion3.0 is a text - to - image model finetuned from Protogen, capable of generating high - quality D&D character images, especially effective at resolutions greater than 512x512.

🚀 Quick Start

FOR THE NEW VERSION DOWNLOAD 'D&Diffusion3.0_Protogen.ckpt'.

The newest version is finetuned from Protogen to great effect. Also works great at resolutions greater than 512x512!

✨ Features

Species in the New Version

aarakocra, aasimar, air_genasi, centaur, dragonborn, drow, dwarf, earth_genasi, elf, firbolg, fire_genasi, gith, gnome, goblin, goliath, halfling, human, illithid, kenku, kobold, lizardfolk, minotaur, orc, tabaxi, thrikreen, tiefling, tortle, warforged, water_genasi

Classes in the New Version

Artificer, Bard, Barbarian, Cleric, Fighter, Druid, Monk, Paladin, Rogue, Ranger, Sorcerer, Warlock, Wizard, Noble, Townsperson

Training Dataset

See the training dataset here for a list of races: https://huggingface.co/datasets/0xJustin/Dungeons-and-Diffusion

Model Performance

Model16000 is trained using D&D character as the class prompt, and for whatever reason it ~ seems ~ to work better for centaurs and aarakocra.
Model30000 is trained using all of the images as the class images, and I think it emulates the commission DnD character style better. It works VERY well for most races, though sometimes I have to fight to get aarakocra to not be birds or centaurs to not be horses. Tieflings work great, but reining in their horns can be trouble. There is some bleed through between classes - especially for elf ears and horns. Including elf ears and horns as negative prompts seems to help.

💻 Usage Examples

Good Prompts to Try

modelshoot style, (extremely detailed CG unity 8k wallpaper), full shot body photo of the most beautiful artwork in the world, english medieval pink (dragonborn druid) witch, black silk robe, nature magic, medieval era, painting by Ed Blinkey, Atey Ghailan, Studio Ghibli, by Jeremy Mann, Greg Manchess, Antonio Moro, trending on ArtStation, trending on CGSociety, Intricate, High Detail, Sharp focus, dramatic, painting art by midjourney and greg rutkowski, teal and gold, petals, countryside, action pose, casting a spell, green swirling magic

Negative prompt: canvas frame, cartoon, 3d, photorealistic Steps: 20, Sampler: DPM++ 2M Karras, CFG scale: 10, Seed: 2603924688, Size: 512x768, Batch size: 4, Batch pos: 1, Clip skip: 2

[natural colors], full body tiefling (knight), [watercolor digital 2D painting], (strong shading), hard shadows, blurry, elegant, wearing robes, style of (saga comic) Lois van Baarle and charlie bowater and Sui Ishida, messy, disheveled, thick brushwork, detailed face and eyes, concept art

portrait (painting) of tabaxi, de Rivia closeup, suit, collar, formal attire, D&D, fantasy, intricate, elegant, highly detailed, artstation, concept art, matte, sharp focus, (brush strokes), (oil on canvas), hearthstone, art by Titian and Greg Rutkowski and Rembrandt van Rijn and Alphonse Mucha

(inspired by Reddit post)

📄 License

This model is licensed under the creativeml-openrail-m license.

Featured Recommended AI Models

Empowering the Future, Your AI Solution Knowledge Base

English 简体中文繁體中文にほんご