My stuff

  • My Workflows

  • Liked Workflows

  • Following Workflows

Go to OpenArt main site
Upload workflow

视频转绘换脸_v4(ipadapte+ animatediff + facedtailer/reactor + backgroud_mask)

5.0

1 reviews
28
10.6K
1.9K
2
Description

(This template is used for Workflow Contest)

What this workflow does

用于视频换脸的v2版本

输入视频和人像照片换脸

四种人脸修复方式

背景保持


How to use this workflow

1. 将我工作流程配置文件拖入到comfyui界面

2. 下载ComfyUI-Manager插件到comfyui扩展结点目录,并重启

3. 使用ComfyUI-Manager插件的安装缺失节点功能,安装所有缺失节点

如果这一步出错请参照我的节点目录一一下载,当然,有些和这个流程无关

+---AIGODLIKE-COMFYUI-TRANSLATION

+---ComfyUI-Advanced-ControlNet

+---ComfyUI-AnimateDiff-Evolved

+---ComfyUI-Custom-Scripts

+---ComfyUI-Image-Selector

+---ComfyUI-Impact-Pack

+---ComfyUI-Manager

+---ComfyUI-VideoHelperSuite

+---comfyui_controlnet_aux

+---ComfyUI_Custom_Nodes_AlekPet

+---ComfyUI_FizzNodes

+---ComfyUI_IPAdapter_plus

+---ComfyUi_PromptStylers

+---comfy_mtb

+---Derfuu_ComfyUI_ModdedNodes

+---efficiency-nodes-comfyui

+---facedetailer

+---facerestore_cf

+---comfyui-reactor-node

\---ymc-node-suite-comfyui

特别注意

其中+---ComfyUI-Impact-Pack

这个插件需要修改根目录下的配置文件,具体请参照 https://github.com/ltdrdata/ComfyUI-Impact-Pack#installation

其中+---comfyui-reactor-node

这个插件需要安装一些依赖,如果你不需要可以删除这个相关节点,可插拔

https://github.com/Gourieff/comfyui-reactor-node

4.  去huggingface上下载你需要的模型, 放到插件目录下的对应目录或者comfyui/models目录里,每个模型都有对应的位置,请对号入座

ip-adpter:  https://huggingface.co/h94/IP-Adapter/tree/main/models
to(ComfyUI\custom_nodes\ComfyUI_IPAdapter_plus\models)

其中clip_version在 https://huggingface.co/h94/IP-Adapter/blob/main/models/image_encoder/model.safetensors

请将这个文件下载到本地然后重新命名为自己想要的名字比如我工作流程中的ip-adapter--clipversion.safetensors

to  (ComfyUI\models\clip_vision)

animatediff:  

https://huggingface.co/CiaraRowles/TemporalDiff/tree/main

to (ComfyUI\custom_nodes\ComfyUI-AnimateDiff-Evolved\models)

5.  上传你的图片和视频,调整视频输出的图片尺寸

6.  点击运行

Tips about this workflow

视频帧的多少和输入图片的大小可以自己调整,这只是一个参照demo

输入图片大小越大第一步出来的视频脸部越清晰,配置不好的人请调小这个选项,主要使用第二步

第二步facedetail流程出来的脸部多少有点闪烁, 主要使用第二步的可以调小重绘幅度,乃至直接去掉animatediff

可以通过减小帧率的方式来减少闪烁

我还在尝试其他换脸插件,接下来的流程可能会用v2 v3的形式出现

v2: new: 添加了两种新的facerestore方式:reactor和面部修复,输出由原来的两个转成了四个,请自行挑选合适你的方法

v4: new: 添加了背景蒙版,只重绘人物区域

🎥 Video demo link (optional)

video: https://huggingface.co/xjyplayer/demo/resolve/main/1.mp4?download=true

img:  https://huggingface.co/xjyplayer/demo/resolve/main/202311291152130.png?download=true

Discussion

(No comments yet)

Loading...

Author

2
4.3K
81
25.0K

No reviews yet

  • - latest (2 years ago)

  • - v20231130-095550

  • - v20231130-064746

Primitive Nodes (1)

IPAdapterApply (1)

Custom Nodes (32)

AnimateDiff Evolved

  • - ADE_AnimateDiffUniformContextOptions (1)

  • - ADE_AnimateDiffLoaderWithContext (1)

ComfyUI

  • - CLIPVisionLoader (1)

  • - PreviewImage (2)

  • - LoadImage (1)

  • - VAEDecode (1)

  • - CLIPTextEncode (1)

  • - VAEEncode (2)

  • - KSampler (1)

  • - CheckpointLoaderSimple (1)

  • - SetLatentNoiseMask (1)

  • - ImageScale (1)

  • - ImageListToImageBatch (1)

  • - ToDetailerPipe (1)

  • - ImpactImageBatchToImageList (1)

  • - UltralyticsDetectorProvider (1)

  • - SAMLoader (1)

  • - FaceDetailerPipe (1)

  • - IPAdapterModelLoader (1)

  • - VHS_VideoCombine (4)

  • - VHS_LoadVideo (1)

  • - FaceRestoreModelLoader (1)

  • - FaceRestoreCFWithModel (1)

  • - BatchPromptSchedule (1)

  • - Image Remove Background Rembg (mtb) (1)

  • - ReActorFaceSwap (1)

  • - pipe-util-to-basic-pipe (1)

Checkpoints (1)

majicmix7.safetensors

LoRAs (0)