Go to OpenArt main site
Upload workflow

[v2.0] AnimateDiff ControlNet Animation Raw _v2 - LCM [Part 2]

5.0

3 reviews
284
53.7K
15.2K
6
Description
New Update v2.1 !!! YOUTUBE Video Available Here :  https://youtu.be/qczh3caLZ8o

.

.

Convert Anything into Anything

A series of 5 workflows, for easy understanding, usage, and more clarity.

The Workflow is divided into 5 parts :


What this workflow does


This workflow can convert any (cartoon/realistic/anime) video into another (Cartoon/Realistic/Anime) video.

Make stylize videos, Render 3D concepts, Convert Anime to Realistic, Make Abstract Animations, It's application are limitless, as control passes can be generated through any 3D or 2D software as well.


*This workflow use "batch2batch" processing so any video length duration can be made or converted.


How to use this workflow

This workflow utilized "only the ControlNet images" from external source which are already pre-rendered before hand in Part 1 of this workflow  which saves GPU's memory and skips the Loading time for controlnet (2-5 second delay for every frame)  which saves a lot of time for doing final animation.

The Passes can be created for anything, humans, animals, cars, nature, abstract things and even from 3D CG renders, This new technology opens up doorways to a whole new technique of Rendering.As a 3D artist, this technique can minimize the efforts needed to achieve a good quality output and in only a few amount of time.

Steps:

  • 1) Choose Model checkpoint you want to use
  • 2) Enter Width and Height of your Output Image
  • 3) Choose Positive Prompts you want to see in the output
  • 4) Choose Loras, (You have to experiment which looks good or not)
  • 5) Paste the Passes Directories in ControlNets (1 and 2) Loaders and set their models and weight (See Neon Purple note)
  • 6) Paste The Directory where you want to save the Images in the Output Save Directory Node
  • 7) Select Batch Range (Number of images you want to render in one Queue)
  • 8) Choose LCM Settings, Default is good but experimental (See note)
  • 9) After every batch you can increase the batch naming for organizing the batches.
  • 10) After every queue increase the skip frames to the Total number of images rendered already.
  • 11) After All the batches are rendered it's Ready for [Part 3] Refiner workflow


Tips about this workflow

Old Version - 1 of this workflow : https://youtu.be/HbfDjAMFi6w

Tips and Trick About for this workflow : https://youtu.be/aysg2vFFO9g


Important Documented Tutorial:

https://www.patreon.com/posts/update-animate-94523632  


My Discord Server : https://discord.gg/z9rgJyfPWJ

Discussion

(No comments yet)

Loading...

Author

27
98.4K
2.1K
2.3M

No reviews yet

  • - latest (7 months ago)

Primitive Nodes (32)

Note (13)

PrimitiveNode (5)

Reroute (14)

Custom Nodes (38)

AnimateDiff Evolved

  • - ADE_AnimateDiffUniformContextOptions (1)

  • - CheckpointLoaderSimpleWithNoiseSelect (1)

  • - ADE_AnimateDiffLoaderWithContext (1)

  • - CR Integer To String (1)

  • - CR LoRA Stack (2)

  • - CR Apply LoRA Stack (1)

ComfyUI

  • - EmptyLatentImage (1)

  • - PreviewImage (3)

  • - CLIPSetLastLayer (1)

  • - ControlNetApplyAdvanced (2)

  • - LoraLoader (1)

  • - KSampler (1)

  • - ModelSamplingDiscrete (1)

  • - VAELoader (1)

  • - VAEDecode (1)

  • - ControlNetLoaderAdvanced (2)

  • - LoadImagesFromDirectory (2)

  • - VHS_SplitImages (3)

  • - FloatConstant (1)

  • - Int Literal (2)

  • - Cfg Literal (1)

  • - smZ CLIPTextEncode (2)

  • - Text Multiline (2)

  • - Text String (1)

  • - Text Concatenate (1)

  • - Image Save (1)

  • - String to Text (1)

Checkpoints (1)

imp_v10.safetensors

LoRAs (1)

lcm_pytorch_lora_weights.safetensors