Wan2.1 T2V 1.3B Crush Smol V0

🚀 Wan2.1-T2V-1.3B 模型LoRA微調項目

本項目是對Wan-AI/Wan2.1-T2V-1.3B-Diffusers模型進行的LoRA微調，使用了finetrainers/crush-smol數據集。通過微調，模型在特定任務上可能會有更好的表現。

🚀 快速開始

推理代碼示例

import torch
from diffusers import WanPipeline
from diffusers.utils import export_to_video

pipe = WanPipeline.from_pretrained(
    "Wan-AI/Wan2.1-T2V-1.3B-Diffusers", torch_dtype=torch.bfloat16
).to("cuda")
pipe.load_lora_weights("finetrainers/Wan2.1-T2V-1.3B-crush-smol-v0", adapter_name="wan-lora")
pipe.set_adapters(["wan-lora"], [0.75])

video = pipe("<my-awesome-prompt>").frames[0]
export_to_video(video, "output.mp4", fps=24)

代碼倉庫

代碼可在此處獲取。

訓練日誌

訓練日誌可在WandB 這裡查看。

✨ 主要特性

• 基於diffusers庫進行開發。
• 對Wan-AI/Wan2.1-T2V-1.3B-Diffusers模型進行LoRA微調。
• 支持文本到視頻的生成任務。

📦 模型與數據信息

📄 許可證

本項目使用的許可證為其他。

🔍 示例輸出

以下是一些示例輸入和對應的輸出視頻鏈接：

• 輸入文本：PIKA_CRUSH A large metal cylinder is seen pressing down on a pile of colorful jelly beans, flattening them as if they were under a hydraulic press. 輸出視頻：final-3000-0-2-PIKA_CRUSH-A-large-metal-.mp4
• 輸入文本：PIKA_CRUSH A green cube is being compressed by a hydraulic press, which flattens the object as if it were under a hydraulic press. The press is shown in action, with the cube being squeezed into a smaller shape 輸出視頻：final-3000-1-2-PIKA_CRUSH-A-green-cube-i.mp4
• 輸入文本：PIKA_CRUSH A large metal cylinder is seen pressing down on a pile of Oreo cookies, flattening them as if they were under a hydraulic press. 輸出視頻：final-3000-1-2-PIKA_CRUSH-A-large-metal-.mp4

⚠️ 重要提示

⚠️ 重要提示

這是一個實驗性的檢查點，其泛化能力較差是已知的。在使用時請謹慎評估其效果。