[v2.0] AnimateDiff Face Fix - LCM [Part 4]
5.0
0 reviewsDescription
New Update v2.1 !!! Available Here : https://www.patreon.com/posts/update-v2-1-lcm-95056616
.
.
Convert Anything into Anything
A series of 5 workflows, for easy understanding, usage, and more clarity.
The Workflow is divided into 5 parts :
- Part 1 - ControlNet Passes Export
- Part 2 - Animation Raw - LCM
- Part 3 - AnimateDiff Refiner - LCM
- Part 4 - AnimateDiff Face Fix - LCM
- Part 5 - Batch Face Swap - ReActor [Optional] [Experimental]
This Workflow fixes the bad faces produced in animateDiff animation from [Part 3] or after refined {Part 4]
[Optional] If you don't have faces in your video, or faces are looking good you can skip this workflow
If you see face flicker in your refiner pass, you can use this workflow again to reduce the flickering just update the input and output folders.
HOW TO USE:
After you have refined the Images in [Part 3] AnimateDiff Refiner,
1) Enter the Paths in Purple Directory Nodes of the Refined Images from [Part 3]
2) Enter the Output path for saving them
3) Enter Batch Range for face fix, you can try to put all images (Enter the total number of input images), in one go as only face area will be rendered so Ram will be free. (took only about 6gb vram for 350 images, 2GB free but took 2 hours to render)
4) Skip Frame is 0 by default (Ignore if you put all images in batch range)
5) Enter Denoise value, it should be around 0.25 - 0.45 for best results. 0.4 is default.
(artifacts, sliding can be seen around neck and detection edges, use lower values if you see any) or you can use lower values and again use this workflow to refine the faces.
6) Enter Prompts for face only, for more accuracy.
7) Choose Model checkpoint you want to use.
TIPS
You can Use this face fix pass for any video. Even from old workflows or SVD,
- Extract frames using [Part 1] or After Effects and input the original frames in the input directory node
- Enter Output Path
- Set Denoise to 0.4 - 0.5
- Enter Prompts for more Accuracy
Run it !
Important Documented Tutorial:
https://www.patreon.com/posts/update-animate-94523632
My Discord Server : https://discord.gg/z9rgJyfPWJ
Discussion
(No comments yet)
Loading...
Reviews
No reviews yet
Versions (1)
- latest (a year ago)
Node Details
Primitive Nodes (10)
Note
PrimitiveNode
Reroute
Custom Nodes (38)
- ADE_AnimateDiffUniformContextOptions
- ADE_AnimateDiffLoaderWithContext
- CR Integer To String
- CR LoRA Stack
- CR Apply LoRA Stack
ComfyUI
- VAELoader
- LoraLoader
- ModelSamplingDiscrete
- ImageScaleBy
- PreviewImage
- CheckpointLoaderSimple
- UltralyticsDetectorProvider
- SAMLoader
- ToBasicPipe
- ImpactSimpleDetectorSEGS_for_AD
- SEGSDetailerForAnimateDiff
- SEGSPaste
- LoadImagesFromDirectory
- VHS_SplitImages
- FloatConstant
- ColorMatch
- ShowText|pysssss
- Cfg Literal
- Int Literal
- smZ CLIPTextEncode
- GetImageSize
- Text Multiline
- Image Save
- String to Text
Model Details
Checkpoints (1)
imp_v10.safetensors
LoRAs (1)
lcm_pytorch_lora_weights.safetensors