Go to OpenArt main site
Upload workflow

[v2.0] AnimateDiff Face Fix - LCM [Part 4]

5.0

0 reviews
89
19.7K
3.4K
1
Description

New Update v2.1 !!! Available Here :  https://www.patreon.com/posts/update-v2-1-lcm-95056616

.

.

Convert Anything into Anything

A series of 5 workflows, for easy understanding, usage, and more clarity.

The Workflow is divided into 5 parts :


This Workflow fixes the bad faces produced in animateDiff animation from [Part 3] or after refined {Part 4]

                                                                                 

[Optional] If you don't have faces in your video, or faces are looking good you can skip this workflow

If you see face flicker in your refiner pass, you can use this workflow again to reduce the flickering just update the input and output folders.


HOW TO USE:


After you have refined the Images in [Part 3] AnimateDiff Refiner,


1) Enter the Paths in Purple Directory Nodes of the Refined Images from [Part 3]

2) Enter the Output path for saving them

3) Enter Batch Range for face fix, you can try to put all images (Enter the total number of input images), in one go as only face area will be rendered so Ram will be free. (took only about 6gb vram for 350 images, 2GB free but took 2 hours to render)


4) Skip Frame is 0 by default (Ignore if you put all images in batch range)

5) Enter Denoise value, it should be around 0.25 - 0.45 for best results. 0.4 is default.

(artifacts, sliding can be seen around neck and detection edges, use lower values if you see any) or you can use lower values and again use this workflow to refine the faces.


6) Enter Prompts for face only, for more accuracy.  

7) Choose Model checkpoint you want to use.


TIPS

You can Use this face fix pass for any video. Even from old workflows or SVD,

  • Extract frames using [Part 1] or After Effects and input the original frames in the input directory node
  • Enter Output Path
  • Set Denoise to 0.4 - 0.5
  • Enter Prompts for more Accuracy

Run it !


Important Documented Tutorial:

https://www.patreon.com/posts/update-animate-94523632  


My Discord Server : https://discord.gg/z9rgJyfPWJ

Discussion

(No comments yet)

Loading...

Author

27
98.4K
2.1K
2.3M

No reviews yet

  • - latest (7 months ago)

Primitive Nodes (10)

Note (2)

PrimitiveNode (2)

Reroute (6)

Custom Nodes (38)

AnimateDiff Evolved

  • - ADE_AnimateDiffUniformContextOptions (1)

  • - ADE_AnimateDiffLoaderWithContext (1)

  • - CR Integer To String (2)

  • - CR LoRA Stack (1)

  • - CR Apply LoRA Stack (1)

ComfyUI

  • - VAELoader (1)

  • - LoraLoader (1)

  • - ModelSamplingDiscrete (1)

  • - ImageScaleBy (1)

  • - PreviewImage (2)

  • - CheckpointLoaderSimple (1)

  • - UltralyticsDetectorProvider (1)

  • - SAMLoader (1)

  • - ToBasicPipe (1)

  • - ImpactSimpleDetectorSEGS_for_AD (1)

  • - SEGSDetailerForAnimateDiff (1)

  • - SEGSPaste (1)

  • - LoadImagesFromDirectory (1)

  • - VHS_SplitImages (2)

  • - FloatConstant (3)

  • - ColorMatch (1)

  • - Cfg Literal (1)

  • - Int Literal (1)

  • - smZ CLIPTextEncode (2)

  • - GetImageSize (1)

  • - Text Multiline (2)

  • - Image Save (1)

  • - String to Text (2)

Checkpoints (1)

imp_v10.safetensors

LoRAs (1)

lcm_pytorch_lora_weights.safetensors