Go to OpenArt main site
Upload workflow

Depth and Parallax Images and Videos

5.0

1 reviews
192
27.5K
7.5K
1
Description

What this workflow does

a workflow for creating an image with a depth perspective effect using IPAdapters. This image can be animated using Stable Video Diffusion to produce a ping pong video with a 3D or volumetric appearance. All of this in the same workflow.


How to use this workflow

You will need to use a mask image with three stacked layers, green blue and red (check examples). Then you can use three input image to be adapted in these three regions. This is used to create the composition, specifically the foreground and the central part. It's important to create an image with a convincing depth perspective, as the quality of the final video depends on it.


Tips about this workflow

Before running the full workflow, bypass the Ksampler node in the Video group, so that you can check if the image to animate looks good first. Also, you might need to find the right motion_bucket_id and seed to generate the proper camera pan, it might change depending on the depth of the input image.

You can download an example mask and input images in the workflow-inputs.zip:  https://civitai.com/articles/3235/a-workflow-for-depthparallax-images-and-videos-using-ipadapters-and-stable-video-diffusion

Discussion

(No comments yet)

Loading...

Author

17
22.1K
496
87.7K

No reviews yet

  • - latest (7 months ago)

Primitive Nodes (5)

IPAdapterApply (3)

Note (1)

Seed (rgthree) (1)

Custom Nodes (30)

ComfyUI

  • - LoadImage (3)

  • - EmptyLatentImage (1)

  • - FreeU_V2 (1)

  • - VAEDecode (2)

  • - ImageOnlyCheckpointLoader (1)

  • - VAELoader (1)

  • - VideoLinearCFGGuidance (1)

  • - PreviewImage (1)

  • - KSampler (2)

  • - SVD_img2vid_Conditioning (1)

  • - CLIPVisionLoader (1)

  • - CheckpointLoaderSimple (1)

  • - CLIPTextEncode (2)

  • - LoadImageMask (3)

ComfyUI Essentials

  • - MaskPreview+ (3)

  • - PrepImageForClipVision (3)

  • - IPAdapterModelLoader (1)

  • - VHS_VideoCombine (1)

Checkpoints (2)

photon_v1.safetensors

svd_image_decoder.safetensors

LoRAs (0)