What this workflow does

This versatile workflow empowers users to seamlessly transform videos of various styles -- whether they be cartoon, realistic or anime -- into alternative visual formats. With its capabilities, you can effortlessly stylize videos and bring your vision to life. Convert anime sequences into realistic portrayals, and craft captivating abstract animations. The application of this workflow are boundless, offering a creative toolkit for a wide range of visual transformations. Customize weight of  your IP adapter and prompt to  your liking. Additionally you can use prompt scheduler for versatile outputs. Have fun :).

How to use this workflow

Steps :

1) Choose Model checkpoint and VAE you want to use (blue group input)

2) Enter Width and Height of your Output Image (blue input)

3) Paste The Directory from where you want  to import video or image path (blue group input)

4) Choose Loras and set up clip skip to your model preferences

5) Set up your ControlNets (1, 2 and 3) and loaders and set their models and weight (controlnet group red)

6) Choose Positive Prompts you want to see in the output (green group prompt)

7) Set up IP adapter and choose  picture of your  liking to influence output (purple group Ip adapter)

8) Choose AnimeDiff model and change fix or randomize seed (yellow group AnimeDiff)

9) Adjust Ksamplers to your linking

Tips about this workflow

Bypass upscale group and limit video input frames and resolution to lets say 40 frames for tests till you get result you are happy with it will speed up process.

Video Link Instagram :  https://www.instagram.com/p/C0H8-YtiW9R/