Free Digital Human(无限数字人)
5.0
0 reviewsDescription
全流程 comfyUI 数字人工作流
一个使用简单但功能强大的工作流,工作流匹配教程在评论区,目前是beta版本,因为太多人找我要工作流,所以先发出来,会持续优化效果,主要是提升声音的克隆和画面人物的贴合程度。
目前的工作流大家只需上传 2 个原视频和 1 段用于复现声音的音频就可以了,后续会开源专属这个工作流的comfyUI整合包,因为使用的节点插件都很难安装。
目前能够实现的效果是数字人的制作、voice Translation ,可以作为 raskAI & runway 平台中 翻译文字对口型等效果的平替产品。
by 牧新
This is a easy use yet powerful workflow. You can find the matching tutorial in the comments section. Currently, it's in beta because a lot of people have been asking for the workflow, so I'm sharing it now and will keep improving its effectiveness, especially in voice cloning and character alignment.
With the current workflow, you only need to upload 2 original videos and 1 audio clip to replicate the voice. In the future, I will release an open-source ComfyUI integration package specifically for this workflow since the node plugins used are quite difficult to install.
The workflow can currently achieve digital human creation and voice translation, making it a viable alternative to platforms like RaskAI & Runway for tasks such as lip-syncing translated text.
By Muxin
Discussion
(No comments yet)
Loading...
Reviews
No reviews yet
Versions (3)
- latest (a year ago)
- v20240702-174346
- v20240702-174011
Node Details
Primitive Nodes (31)
AudioPlay (3)
ChatTTS_ (1)
GetNode (2)
LoadAndCombinedAudio_ (1)
LoadWhisperModel (1)
Note (15)
OpenVoiceClone (1)
Qwen2_ModelLoader_Zho (1)
Qwen2_Zho (1)
SetNode (1)
UNETLoader_MuseTalk (1)
muse_talk_sampler (1)
vhs_audio_to_audio_tensor (1)
whisper_to_features (1)
Custom Nodes (25)
ComfyUI
- EmptyImage (1)
- ImageToMask (1)
- MaskToImage (1)
- ImageCompositeMasked (1)
- VAELoader (1)
- PreviewImage (1)
- ImageResize+ (2)
- PixelPerfectResolution (1)
- DWPreprocessor (1)
- Apply Whisper (1)
- VHS_VideoCombine (5)
- VHS_LoadVideo (2)
- VHS_LoadAudio (1)
- BatchUncrop (1)
- BatchCropFromMask (1)
- GrowMaskWithBlur (1)
- ShowText|pysssss (2)
- String Literal (1)
Model Details
Checkpoints (0)
LoRAs (0)