Hunyuanvideo I2V

🚀 HunyuanVideo-I2V 圖像轉視頻項目

本項目是基於 tencent/HunyuanVideo-I2V 的非官方社區版本，提供了適用於 Diffusers 庫的權重。它能夠幫助用戶利用圖像生成視頻，為圖像到視頻的轉換任務提供了便捷的解決方案。

🚀 快速開始

環境準備

HunyuanVideo-I2V 可以直接通過 Diffusers 庫使用。首先，請安裝最新版本的 Diffusers 庫。

代碼示例

import torch
from diffusers import HunyuanVideoImageToVideoPipeline, HunyuanVideoTransformer3DModel
from diffusers.utils import load_image, export_to_video

# 可用的檢查點: "hunyuanvideo-community/HunyuanVideo-I2V" 和 "hunyuanvideo-community/HunyuanVideo-I2V-33ch"
model_id = "hunyuanvideo-community/HunyuanVideo-I2V"
transformer = HunyuanVideoTransformer3DModel.from_pretrained(
    model_id, subfolder="transformer", torch_dtype=torch.bfloat16
)
pipe = HunyuanVideoImageToVideoPipeline.from_pretrained(
    model_id, transformer=transformer, torch_dtype=torch.float16
)
pipe.vae.enable_tiling()
pipe.to("cuda")

prompt = "A man with short gray hair plays a red electric guitar."
image = load_image(
    "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/guitar-man.png"
)

output = pipe(image=image, prompt=prompt).frames[0]
export_to_video(output, "output.mp4", fps=15)

更多詳細信息請參考 文檔。

💻 使用示例

基礎用法

import torch
from diffusers import HunyuanVideoImageToVideoPipeline, HunyuanVideoTransformer3DModel
from diffusers.utils import load_image, export_to_video

# 可用的檢查點: "hunyuanvideo-community/HunyuanVideo-I2V" 和 "hunyuanvideo-community/HunyuanVideo-I2V-33ch"
model_id = "hunyuanvideo-community/HunyuanVideo-I2V"
transformer = HunyuanVideoTransformer3DModel.from_pretrained(
    model_id, subfolder="transformer", torch_dtype=torch.bfloat16
)
pipe = HunyuanVideoImageToVideoPipeline.from_pretrained(
    model_id, transformer=transformer, torch_dtype=torch.float16
)
pipe.vae.enable_tiling()
pipe.to("cuda")

prompt = "A man with short gray hair plays a red electric guitar."
image = load_image(
    "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/guitar-man.png"
)

output = pipe(image=image, prompt=prompt).frames[0]
export_to_video(output, "output.mp4", fps=15)

高級用法

目前文檔未提供高級用法的相關代碼，你可以參考 文檔 探索更多功能。

📚 詳細文檔

更多關於 HunyuanVideo-I2V 的詳細信息，請參考 官方文檔。

📦 模型信息