FLUX.1 Dev GGUF

🚀 FLUX.1-dev-GGUF

FLUX.1-dev-GGUF is a text-to-image model based on the FLUX.1-dev architecture, offering various quantization options for image generation.

🚀 Quick Start

This model is experimental and is only supported by gpustack/llama-box v0.0.77+.

✨ Features

• Model Information:
  • Model creator: Black Forest Labs
  • Original model: FLUX.1-dev
  • GGUF quantization: Based on stable-diffusion.cpp ac54e patched by llama-box.
• Quantization Options: | Quantization | OpenAI CLIP ViT-L/14 Quantization | Google T5-xxl Quantization | VAE Quantization | | --- | --- | --- | --- | | FP16 | FP16 | FP16 | FP16 | | Q8_0 | FP16 | Q8_0 | FP16 | | (pure) Q8_0 | Q8_0 | Q8_0 | FP16 | | Q4_1 | FP16 | Q8_0 | FP16 | | Q4_0 | FP16 | Q8_0 | FP16 | | (pure) Q4_0 | Q4_0 | Q4_0 | FP16 |
• Output Quality: Cutting-edge output quality, second only to the state-of-the-art model FLUX.1 [pro].
• Prompt Following: Competitive prompt following, matching the performance of closed - source alternatives.
• Training Method: Trained using guidance distillation, making FLUX.1 [dev] more efficient.
• Open Weights: Open weights to drive new scientific research and empower artists to develop innovative workflows.
• Usage License: Generated outputs can be used for personal, scientific, and commercial purposes as described in the FLUX.1 [dev] Non - Commercial License.

FLUX.1 [dev] is a 12 - billion parameter rectified flow transformer capable of generating images from text descriptions. For more information, please read our blog post.

💻 Usage Examples

Basic Usage

To use FLUX.1 [dev] with the 🧨 diffusers python library, first install or upgrade diffusers:

pip install -U diffusers

Then you can use FluxPipeline to run the model:

import torch
from diffusers import FluxPipeline

pipe = FluxPipeline.from_pretrained("black-forest-labs/FLUX.1-dev", torch_dtype=torch.bfloat16)
pipe.enable_model_cpu_offload() #save some VRAM by offloading the model to CPU. Remove this if you have enough GPU power

prompt = "A cat holding a sign that says hello world"
image = pipe(
    prompt,
    height=1024,
    width=1024,
    guidance_scale=3.5,
    num_inference_steps=50,
    max_sequence_length=512,
    generator=torch.Generator("cpu").manual_seed(0)
).images[0]
image.save("flux-dev.png")

To learn more check out the diffusers documentation.

Advanced Usage

API Endpoints

The FLUX.1 models are also available via API from the following sources:

• bfl.ml (currently FLUX.1 [pro])
• replicate.com
• fal.ai
• mystic.ai

ComfyUI

FLUX.1 [dev] is also available in Comfy UI for local inference with a node - based workflow.

📚 Documentation

Limitations

• This model is not intended or able to provide factual information.
• As a statistical model, this checkpoint might amplify existing societal biases.
• The model may fail to generate output that matches the prompts.
• Prompt following is heavily influenced by the prompting - style.

Out - of - Scope Use

The model and its derivatives may not be used:

• In any way that violates any applicable national, federal, state, local or international law or regulation.
• For the purpose of exploiting, harming or attempting to exploit or harm minors in any way; including but not limited to the solicitation, creation, acquisition, or dissemination of child exploitative content.
• To generate or disseminate verifiably false information and/or content with the purpose of harming others.
• To generate or disseminate personal identifiable information that can be used to harm an individual.
• To harass, abuse, threaten, stalk, or bully individuals or groups of individuals.
• To create non - consensual nudity or illegal pornographic content.
• For fully automated decision making that adversely impacts an individual's legal rights or otherwise creates or modifies a binding, enforceable obligation.
• Generating or facilitating large - scale disinformation campaigns.

📄 License

This model falls under the FLUX.1 [dev] Non - Commercial License. By clicking "Agree", you agree to the FluxDev Non - Commercial License Agreement and acknowledge the Acceptable Use Policy.