Go to OpenArt main site
Upload workflow

Ani's Txt2Img2Vid Workflow

5.0

0 reviews
55
9.0K
1.8K
7
Description

Full Video Link:  https://files.catbox.moe/kqwcod.mp4

What this workflow does

Text to image keyframes using composable diffusion into animate diff interpolated frames. You are able to swap keyframes for any other result using the load images. Use the control net strength schedule to blend the keyframes into a coherent animation.

How to use this workflow

Use the prompt inputs to determine the keyframes. Animate diff will use a calculated schedule based on what keyframes you prompted. More instructions are included inside workflow notes!

Tips about this workflow

use the current frame to make the next clip in a sequence and chain them together using the vhs output nodes. The example video is using 6 separate clips!

Discussion

(No comments yet)

Loading...

Author

1
1.8K
55
9.0K

No reviews yet

  • - latest (6 months ago)

  • - v20231216-043324

Primitive Nodes (168)

Note (29)

PrimitiveNode (42)

Reroute (95)

Text box (2)

Custom Nodes (126)

AnimateDiff Evolved

  • - ADE_AnimateDiffUniformContextOptions (1)

  • - ADE_EmptyLatentImageLarge (1)

  • - ADE_AnimateDiffModelSettingsAdvancedAttnStrengths (1)

  • - ADE_AnimateDiffLoaderWithContext (1)

  • - CheckpointLoaderSimpleWithNoiseSelect (1)

  • - CM_IntBinaryOperation (14)

  • - CM_IntToNumber (4)

ComfyUI

  • - ControlNetApplyAdvanced (4)

  • - PreviewImage (8)

  • - LoadImage (4)

  • - ImageScale (4)

  • - ImageUpscaleWithModel (4)

  • - LoraLoader (6)

  • - VAEEncode (4)

  • - UpscaleModelLoader (4)

  • - VAEDecode (9)

  • - KSampler (8)

  • - KSamplerAdvanced (2)

  • - CLIPSetLastLayer (1)

  • - EmptyLatentImage (1)

  • - VAELoader (1)

  • - SaveImage (1)

  • - ControlNetLoaderAdvanced (4)

  • - TimestepKeyframe (4)

  • - ScaledSoftControlNetWeights (4)

  • - LatentKeyframeBatchedGroup (4)

  • - Compare (3)

  • - If ANY execute A else B (3)

  • - VHS_LoadImagesPath (1)

  • - VHS_VideoCombine (1)

  • - StringConcatenate (3)

  • - ConcatStringSingle (1)

  • - PromptSchedule (4)

  • - BatchPromptScheduleLatentInput (1)

  • - CalculateFrameOffset (4)

  • - BatchValueScheduleLatentInput (4)

Checkpoints (1)

based66_v30.safetensors

LoRAs (6)

1990sAnimeStyleLora_1.safetensors

boldline.safetensors

chibi-laugh.safetensors

smv1-10.safetensors