Workflow for Advanced Visual Design class.

Note: This requires KJNodes (not in comfymanager) for the GET and SET nodes:  https://github.com/kijai/ComfyUI-KJNodes

You can install it in the ComfyManager by going to "Install via Git URL" in the options in the Manager. Otherwise may need to do it manually.

This workflow has some options to it, but is generally an image to video workflow.  

You load in an image, and it is applied as an IPAdapter at full strength, along with a text prompt.  It runs through an efficient loader that uses any SD1.5 model and a specific AnimateLCM LoRA (t2v) that allows it to be optimized for fast sampling using the LCM sampler in the context of video.

AnimateDiff is used to create the video, and there is an option for enabling/disabling (highlight and use CTRL-B) MotionLoRAs to control the movement within the render (keep their strength below .7).

It uses the "SparseCTRL" ControlNet which helps maintain the same image between frames when it is turning the image into a video.  

Those are the basics.

There are also a lot of extra options in this workflow:

• Prompt Extractor is a node that can extract a prompt from an image. This is useful if you are not getting super accurate results to your image, to push more the details of the original image (or other image if you are experimenting)

• --->To turn this on, highlight the purple nodes in the initialization section and press CTRL-B. After, you will need to make sure the Switch node is wired to the Set Prompt node. Switching between true and false will allow you to choose between using a written prompt (true) or an extracted prompt (false)

• -SDXL Lightning Image Generation is a section that allows to generate a new image from the text prompt before running it into the image to video section. You can turn this on in the Fast Groups Bypasser at the top left of the workflow. It is turned off by default

• -Upscale and 2nd Pass Render is a section that upscales the original frames and then runs a second render pass. This increases the resolution and quality, at the price of speed. Generally you'd want to test all your settings before turning this on, and use this section for when you are ready for more final renders.

• -Interpolate Frames is a section to smooth out the end video render