Wan2.1 T2V 1.3B Crush Smol V0

🚀 Wan2.1-T2V-1.3B 模型LoRA微调项目

本项目是对Wan-AI/Wan2.1-T2V-1.3B-Diffusers模型进行的LoRA微调，使用了finetrainers/crush-smol数据集。通过微调，模型在特定任务上可能会有更好的表现。

🚀 快速开始

推理代码示例

import torch
from diffusers import WanPipeline
from diffusers.utils import export_to_video

pipe = WanPipeline.from_pretrained(
    "Wan-AI/Wan2.1-T2V-1.3B-Diffusers", torch_dtype=torch.bfloat16
).to("cuda")
pipe.load_lora_weights("finetrainers/Wan2.1-T2V-1.3B-crush-smol-v0", adapter_name="wan-lora")
pipe.set_adapters(["wan-lora"], [0.75])

video = pipe("<my-awesome-prompt>").frames[0]
export_to_video(video, "output.mp4", fps=24)

代码仓库

代码可在此处获取。

训练日志

训练日志可在WandB 这里查看。

✨ 主要特性

• 基于diffusers库进行开发。
• 对Wan-AI/Wan2.1-T2V-1.3B-Diffusers模型进行LoRA微调。
• 支持文本到视频的生成任务。

📦 模型与数据信息

📄 许可证

本项目使用的许可证为其他。

🔍 示例输出

以下是一些示例输入和对应的输出视频链接：

• 输入文本：PIKA_CRUSH A large metal cylinder is seen pressing down on a pile of colorful jelly beans, flattening them as if they were under a hydraulic press. 输出视频：final-3000-0-2-PIKA_CRUSH-A-large-metal-.mp4
• 输入文本：PIKA_CRUSH A green cube is being compressed by a hydraulic press, which flattens the object as if it were under a hydraulic press. The press is shown in action, with the cube being squeezed into a smaller shape 输出视频：final-3000-1-2-PIKA_CRUSH-A-green-cube-i.mp4
• 输入文本：PIKA_CRUSH A large metal cylinder is seen pressing down on a pile of Oreo cookies, flattening them as if they were under a hydraulic press. 输出视频：final-3000-1-2-PIKA_CRUSH-A-large-metal-.mp4

⚠️ 重要提示

⚠️ 重要提示

这是一个实验性的检查点，其泛化能力较差是已知的。在使用时请谨慎评估其效果。