视频转绘换脸_v4(ipadapte+ animatediff + facedtailer/reactor + backgroud_mask)
5.0
1 reviewsDescription
(This template is used for Workflow Contest)
What this workflow does
用于视频换脸的v2版本
输入视频和人像照片换脸
四种人脸修复方式
背景保持
How to use this workflow
1. 将我工作流程配置文件拖入到comfyui界面
2. 下载ComfyUI-Manager插件到comfyui扩展结点目录,并重启
3. 使用ComfyUI-Manager插件的安装缺失节点功能,安装所有缺失节点
如果这一步出错请参照我的节点目录一一下载,当然,有些和这个流程无关
+---AIGODLIKE-COMFYUI-TRANSLATION
+---ComfyUI-Advanced-ControlNet
+---ComfyUI-AnimateDiff-Evolved
+---ComfyUI-Custom-Scripts
+---ComfyUI-Image-Selector
+---ComfyUI-Impact-Pack
+---ComfyUI-Manager
+---ComfyUI-VideoHelperSuite
+---comfyui_controlnet_aux
+---ComfyUI_Custom_Nodes_AlekPet
+---ComfyUI_FizzNodes
+---ComfyUI_IPAdapter_plus
+---ComfyUi_PromptStylers
+---comfy_mtb
+---Derfuu_ComfyUI_ModdedNodes
+---efficiency-nodes-comfyui
+---facedetailer
+---facerestore_cf
+---comfyui-reactor-node
\---ymc-node-suite-comfyui
特别注意
其中+---ComfyUI-Impact-Pack
这个插件需要修改根目录下的配置文件,具体请参照 https://github.com/ltdrdata/ComfyUI-Impact-Pack#installation
其中+---comfyui-reactor-node
这个插件需要安装一些依赖,如果你不需要可以删除这个相关节点,可插拔
https://github.com/Gourieff/comfyui-reactor-node
4. 去huggingface上下载你需要的模型, 放到插件目录下的对应目录或者comfyui/models目录里,每个模型都有对应的位置,请对号入座
ip-adpter: https://huggingface.co/h94/IP-Adapter/tree/main/models
to(ComfyUI\custom_nodes\ComfyUI_IPAdapter_plus\models)
其中clip_version在 https://huggingface.co/h94/IP-Adapter/blob/main/models/image_encoder/model.safetensors
请将这个文件下载到本地然后重新命名为自己想要的名字比如我工作流程中的ip-adapter--clipversion.safetensors
to (ComfyUI\models\clip_vision)
animatediff:
https://huggingface.co/CiaraRowles/TemporalDiff/tree/main
to (ComfyUI\custom_nodes\ComfyUI-AnimateDiff-Evolved\models)
5. 上传你的图片和视频,调整视频输出的图片尺寸
6. 点击运行
Tips about this workflow
视频帧的多少和输入图片的大小可以自己调整,这只是一个参照demo
输入图片大小越大第一步出来的视频脸部越清晰,配置不好的人请调小这个选项,主要使用第二步
第二步facedetail流程出来的脸部多少有点闪烁, 主要使用第二步的可以调小重绘幅度,乃至直接去掉animatediff
可以通过减小帧率的方式来减少闪烁
我还在尝试其他换脸插件,接下来的流程可能会用v2 v3的形式出现
v2: new: 添加了两种新的facerestore方式:reactor和面部修复,输出由原来的两个转成了四个,请自行挑选合适你的方法
v4: new: 添加了背景蒙版,只重绘人物区域
🎥 Video demo link (optional)
video: https://huggingface.co/xjyplayer/demo/resolve/main/1.mp4?download=true
img: https://huggingface.co/xjyplayer/demo/resolve/main/202311291152130.png?download=true
Discussion
(No comments yet)
Loading...
Reviews
No reviews yet
Versions (3)
- latest (2 years ago)
- v20231130-095550
- v20231130-064746
Node Details
Primitive Nodes (1)
IPAdapterApply (1)
Custom Nodes (32)
- ADE_AnimateDiffUniformContextOptions (1)
- ADE_AnimateDiffLoaderWithContext (1)
ComfyUI
- CLIPVisionLoader (1)
- PreviewImage (2)
- LoadImage (1)
- VAEDecode (1)
- CLIPTextEncode (1)
- VAEEncode (2)
- KSampler (1)
- CheckpointLoaderSimple (1)
- SetLatentNoiseMask (1)
- ImageScale (1)
- ImageListToImageBatch (1)
- ToDetailerPipe (1)
- ImpactImageBatchToImageList (1)
- UltralyticsDetectorProvider (1)
- SAMLoader (1)
- FaceDetailerPipe (1)
- IPAdapterModelLoader (1)
- VHS_VideoCombine (4)
- VHS_LoadVideo (1)
- FaceRestoreModelLoader (1)
- FaceRestoreCFWithModel (1)
- BatchPromptSchedule (1)
- Image Remove Background Rembg (mtb) (1)
- ReActorFaceSwap (1)
- pipe-util-to-basic-pipe (1)
Model Details
Checkpoints (1)
majicmix7.safetensors
LoRAs (0)