Hunyuanvideo I2V

🚀 HunyuanVideo-I2V 图像转视频项目

本项目是基于 tencent/HunyuanVideo-I2V 的非官方社区版本，提供了适用于 Diffusers 库的权重。它能够帮助用户利用图像生成视频，为图像到视频的转换任务提供了便捷的解决方案。

🚀 快速开始

环境准备

HunyuanVideo-I2V 可以直接通过 Diffusers 库使用。首先，请安装最新版本的 Diffusers 库。

代码示例

import torch
from diffusers import HunyuanVideoImageToVideoPipeline, HunyuanVideoTransformer3DModel
from diffusers.utils import load_image, export_to_video

# 可用的检查点: "hunyuanvideo-community/HunyuanVideo-I2V" 和 "hunyuanvideo-community/HunyuanVideo-I2V-33ch"
model_id = "hunyuanvideo-community/HunyuanVideo-I2V"
transformer = HunyuanVideoTransformer3DModel.from_pretrained(
    model_id, subfolder="transformer", torch_dtype=torch.bfloat16
)
pipe = HunyuanVideoImageToVideoPipeline.from_pretrained(
    model_id, transformer=transformer, torch_dtype=torch.float16
)
pipe.vae.enable_tiling()
pipe.to("cuda")

prompt = "A man with short gray hair plays a red electric guitar."
image = load_image(
    "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/guitar-man.png"
)

output = pipe(image=image, prompt=prompt).frames[0]
export_to_video(output, "output.mp4", fps=15)

更多详细信息请参考 文档。

💻 使用示例

基础用法

import torch
from diffusers import HunyuanVideoImageToVideoPipeline, HunyuanVideoTransformer3DModel
from diffusers.utils import load_image, export_to_video

# 可用的检查点: "hunyuanvideo-community/HunyuanVideo-I2V" 和 "hunyuanvideo-community/HunyuanVideo-I2V-33ch"
model_id = "hunyuanvideo-community/HunyuanVideo-I2V"
transformer = HunyuanVideoTransformer3DModel.from_pretrained(
    model_id, subfolder="transformer", torch_dtype=torch.bfloat16
)
pipe = HunyuanVideoImageToVideoPipeline.from_pretrained(
    model_id, transformer=transformer, torch_dtype=torch.float16
)
pipe.vae.enable_tiling()
pipe.to("cuda")

prompt = "A man with short gray hair plays a red electric guitar."
image = load_image(
    "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/guitar-man.png"
)

output = pipe(image=image, prompt=prompt).frames[0]
export_to_video(output, "output.mp4", fps=15)

高级用法

目前文档未提供高级用法的相关代码，你可以参考 文档 探索更多功能。

📚 详细文档

更多关于 HunyuanVideo-I2V 的详细信息，请参考 官方文档。

📦 模型信息