What's this?

This combines an extension that generates continuations of input images with layout control.

Workflow

You need to prepare three inputs for WanVaceToVideo:

control_video

• This consists of a single image frame that you want to extend, combined with a layout control video.

control_mask

• Since we want VACE to generate the video starting from the second frame, we fill the mask entirely from the second to the final frame, using the first frame as a reference.

reference_image

• This isn't strictly required for the extension, but we include the first frame as a reference to improve stability.

Split Image

• When using a reference_image, the first few frames of the generated video may contain overlapping artifacts between the reference and the generated image. To address this, delete the first ~12 frames.