[v1.0] SVD - AnimateDiff Refiner + Upscaler for More Details and Stable Motion
5.0
3 reviewsDescription
This workflow add animate diff refiner pass, if you used SVD for refiner, the results were not good and If you used Normal SD models for refiner, they would be flickering. So AnimateDiff is used Instead.
What this workflow does
Add more Details to the SVD render, It uses SD models like epic realism (or can be any) for the refiner pass.
Also Suitable for 8GB Ram GPUs.
How to use this workflow
All Nodes are organized and Grouped under headings and proper naming format inside the Workflow with How to use instructions.
1) Use SVD as usual. Inside the workflow
- Upload starting image
- Set svd or svd_xt
- Set fps, motion bucket, augmentation
- Set Resolution (it's set automatically but you can also change acc. to your hardware capacity)
2) Set Refiner Upscale Value and Denoise value
- Use a value around 1.3 - 1.7 in the Refiner Upscale to give a little room in the image to add details.
- Use 0.4 - 0.7 in the Denoise for Best results. The control Net Softedge is used to preserve the elements and shape, you can also use Lineart)
3) Setup Animate Diff Refiner
- Select the model you want to use as the refiner (Eg epic realism, mistoon, realisitic vision) which ever you think suits the best for the image ie cartoon, anime or realisitic
- Select Loras if you want to use them, They work as usual , (Some loras are not compatible with AnimateDiff so you can experiment with them
- Type in the Positive and Negative prompts for more accuracy ( General Words are setup by default, Optional if you want to change)
Go Play!
You can Find the Demo with Documented info about this workflow and it's samples here  :  https://www.patreon.com/posts/ai-svd-with-more-93812677
You can also convert this workflow into SDXL for more details, I have on 8GB vram so I can only test with SD.
My PC Specs:
AMD Ryzen 9 6000 s
32 GB Ram
RTX 3070 Ti - 8GB Laptop GPU
Model - Asus Rog flow x16
Custom Node List:
- https://github.com/WASasquatch/was-node-suite-comfyui
- https://github.com/Suzie1/ComfyUI_Comfyroll_CustomNodes
- https://github.com/shiimizu/ComfyUI_smZNodes
- https://github.com/Kosinkadink/ComfyUI-Advanced-ControlNet
- https://github.com/Kosinkadink/ComfyUI-AnimateDiff-Evolved
- https://github.com/Kosinkadink/ComfyUI-VideoHelperSuite
- https://github.com/giriss/comfy-image-saver
- https://github.com/kijai/ComfyUI-KJNodes
- https://github.com/YMC-GitHub/ymc-node-suite-comfyui
- https://github.com/Stability-AI/stability-ComfyUI-nodes
- https://github.com/pythongosssss/ComfyUI-Custom-Scripts
- https://github.com/LucianoCirino/efficiency-nodes-comfyui
- https://github.com/wolfden/ComfyUi_String_Function_Tree
- https://github.com/Stability-AI/stability-ComfyUI-nodes
- https://github.com/AlekPet/ComfyUI_Custom_Nodes_AlekPet
- https://github.com/FizzleDorf/ComfyUI_FizzNodes
- https://github.com/mcmonkeyprojects/sd-dynamic-thresholding
- https://github.com/giriss/comfy-image-saver
--------------------------------------------------------------------
PYTHON SCALER ERROR FIX :
For someone getting the only one element tensors can be converted to Python scalars You just have to delete the Dynamic Thresholding node from the workflow and it will run fine, without any errors. Link for photo reference: imgur.com/a/9bBNPDo
The Recent Update broke the dynamic thresholding node :/
If you need Cloud GPU : https://www.runcomfy.com/?ref=jerrydavos
My Discord Server : https://discord.gg/z9rgJyfPWJ
Discussion
(No comments yet)
Loading...
Reviews
No reviews yet
Versions (1)
- latest (a year ago)
Node Details
Primitive Nodes (76)
Evaluate Floats
GetNode
Note
Reroute
SetNode
Custom Nodes (65)
- ADE_AnimateDiffLoaderWithContext
- ADE_AnimateDiffUniformContextOptions
- CR Integer To String
- CR Float To String
- CR Apply LoRA Stack
- CR LoRA Stack
ComfyUI
- VAEDecode
- VAEEncode
- SVD_img2vid_Conditioning
- LoraLoader
- VideoLinearCFGGuidance
- KSampler
- PreviewImage
- FreeU_V2
- ImageUpscaleWithModel
- ImageScaleBy
- ImageOnlyCheckpointLoader
- UpscaleModelLoader
- LoadImage
- CheckpointLoaderSimple
- ControlNetApplyAdvanced
- FILM VFI
- HEDPreprocessor
- ControlNetLoaderAdvanced
- If ANY execute A else B
- VHS_VideoCombine
- ColorMatch
- FloatConstant
- ShowText|pysssss
- Int Literal
- smZ CLIPTextEncode
- GetImageSize
- DynamicThresholdingFull
- Seed Everywhere
- Logic Boolean
- Text Multiline
Model Details
Checkpoints (2)
aniverse_v15Pruned.safetensors
svd_xt.safetensors
LoRAs (1)
lcm_pytorch_lora_weights.safetensors