Ani's Txt2Img2Vid Workflow
5.0
0 reviewsDescription
Full Video Link: https://files.catbox.moe/kqwcod.mp4
What this workflow does
Text to image keyframes using composable diffusion into animate diff interpolated frames. You are able to swap keyframes for any other result using the load images. Use the control net strength schedule to blend the keyframes into a coherent animation.
How to use this workflow
Use the prompt inputs to determine the keyframes. Animate diff will use a calculated schedule based on what keyframes you prompted. More instructions are included inside workflow notes!
Tips about this workflow
use the current frame to make the next clip in a sequence and chain them together using the vhs output nodes. The example video is using 6 separate clips!
Discussion
(No comments yet)
Loading...
Reviews
No reviews yet
Versions (2)
- latest (6 months ago)
- v20231216-043324
Node Details
Primitive Nodes (168)
Note (29)
PrimitiveNode (42)
Reroute (95)
Text box (2)
Custom Nodes (126)
- ADE_AnimateDiffUniformContextOptions (1)
- ADE_EmptyLatentImageLarge (1)
- ADE_AnimateDiffModelSettingsAdvancedAttnStrengths (1)
- ADE_AnimateDiffLoaderWithContext (1)
- CheckpointLoaderSimpleWithNoiseSelect (1)
- CM_IntBinaryOperation (14)
- CM_IntToNumber (4)
ComfyUI
- ControlNetApplyAdvanced (4)
- PreviewImage (8)
- LoadImage (4)
- ImageScale (4)
- ImageUpscaleWithModel (4)
- LoraLoader (6)
- VAEEncode (4)
- UpscaleModelLoader (4)
- VAEDecode (9)
- KSampler (8)
- KSamplerAdvanced (2)
- CLIPSetLastLayer (1)
- EmptyLatentImage (1)
- VAELoader (1)
- SaveImage (1)
- ControlNetLoaderAdvanced (4)
- TimestepKeyframe (4)
- ScaledSoftControlNetWeights (4)
- LatentKeyframeBatchedGroup (4)
- Compare (3)
- If ANY execute A else B (3)
- VHS_LoadImagesPath (1)
- VHS_VideoCombine (1)
- NNLatentUpscale (1)
- StringConcatenate (3)
- ConcatStringSingle (1)
- PromptSchedule (4)
- BatchPromptScheduleLatentInput (1)
- CalculateFrameOffset (4)
- BatchValueScheduleLatentInput (4)
Model Details
Checkpoints (1)
based66_v30.safetensors
LoRAs (6)
1990sAnimeStyleLora_1.safetensors
boldline.safetensors
chibi-laugh.safetensors
smv1-10.safetensors