My stuff

  • My Workflows

  • Liked Workflows

  • Following Workflows

Go to OpenArt main site
Upload workflow

[v2.1] AnimateDiff ControlNet Animation Refiner - LCM [Part 3]

5.0

0 reviews
30
10.3K
1.7K
3
Description

1) Video Tutorial :  https://youtu.be/qczh3caLZ8o  

2) Documented Tutorial :  https://www.patreon.com/posts/update-v2-1-lcm-95056616

.


How to use this workflow


As you have already generated raw images from [Part 2] you can further enhance the details from this workflow.


  • 1) Enter the Paths in Purple Directory Nodes of the Raw Images
  • 2) Enter the Output path for saving the refined images.
  • 3) Enter Batch Range
  • 4) Overlapping Frames - 0 is Default (Put 5 or 10 for overlapping cross fade technique between batches)
  • 5) Skip Frame is 0 by default (Increase it after every batch)
  • 6) Batch Number Naming, Increase it by 1 after every batch for organizing.
  • 7) Refiner Upscale - Upscale value is 1.4 by default ( Use 1.4 - 1.8 for best result for SD models)
  • 8) Refiner Denoise - 0.45 by default (Use between 0.4 - 0.6 for best results, Higher value may change the image entirely) * Inject Additional Refiner Noise - Use value 0 - 1 (It enhances the minute details, use with add details lora)
  • 9) Enter Prompts for more accuracy.  
  • 10) Choose Model checkpoint you want to use for refiner.
  • 11) Loras work as usual (Some of not compatible with animatediff, test it first with 10 frames)


Tips about this workflow

You can also use this Refiner as :


1) Vid2Vid stylization


Stylized Video2Video Can also be made with this [Part 3] Refiner workflow:

  • Generate the passes from [Part 1} and it will also produce original frames in a separate folder.
  • Enter the ControlNet Softedge pass and Lineart pass in the controlnet directory node.
  • Use these original frames as raw input in the refiner workflow




My Discord Server : https://discord.gg/z9rgJyfPWJ

Discussion

(No comments yet)

Loading...

Author

30
169.9K
3.3K
2.7M

No reviews yet

  • - latest (2 years ago)

Primitive Nodes (28)

Note (9)

PrimitiveNode (1)

Reroute (18)

Custom Nodes (71)

AnimateDiff Evolved

  • - ADE_AnimateDiffUniformContextOptions (1)

  • - ADE_AnimateDiffLoaderWithContext (1)

  • - ADE_AnimateDiffModelSettingsSimple (1)

  • - CR Integer To String (3)

  • - CR Apply LoRA Stack (1)

  • - CR LoRA Stack (2)

ComfyUI

  • - PreviewImage (6)

  • - ImageScaleBy (1)

  • - KSamplerAdvanced (2)

  • - ModelSamplingDiscrete (1)

  • - ControlNetApplyAdvanced (2)

  • - VAEEncode (1)

  • - VAEDecode (1)

  • - CheckpointLoaderSimple (1)

  • - VAELoader (1)

  • - LoraLoader (1)

  • - BNK_InjectNoise (2)

  • - TonemapNoiseWithRescaleCFG (1)

  • - LoadImagesFromDirectory (3)

  • - ControlNetLoaderAdvanced (2)

  • - VHS_SplitImages (6)

  • - FloatConstant (9)

  • - ColorMatch (1)

  • - ShowText|pysssss (2)

  • - MathExpression|pysssss (1)

  • - Int Literal (6)

  • - Cfg Literal (2)

  • - Seed Generator (1)

  • - smZ CLIPTextEncode (2)

  • - GetImageSize (1)

  • - Text String (1)

  • - Text Multiline (2)

  • - Text Concatenate (1)

  • - Image Save (1)

  • - String to Text (1)

Checkpoints (1)

imp_v10.safetensors

LoRAs (1)

lcm_pytorch_lora_weights.safetensors