Go to OpenArt main site
Upload workflow

[SDXL]Sketch2Video

5.0

0 reviews
17
2.7K
503
0
Description

A workflow to turn some of your most questionable sketches and doodles into an unquestionable masterpiece.

Links for all custom Nodes available below.

PainterNode by AlekPet: https://github.com/AlekPet/ComfyUI_Custom_Nodes_AlekPet/tree/master/PainterNode    

DreamShaper SDXL: https://civitai.com/models/112902/dreamshaper-xl  

SVD model: https://huggingface.co/stabilityai/stable-video-diffusion-img2vid/blob/main/svd.safetensors

OilPaint SDXL: https://civitai.com/models/137963/oilpaint-sdxl


                             Workflow Process/Steps:

[Sketching]

1) Sketch something using the PainterNode

2) Whenever you are satisfied with your sketch, describe what you sketch in the green positive prompt section below the PainterNode

3) adjust the Lora and Ksampler setting to your liking

[Upscaling]

4) When satisfied with your results, use the upscale tab to upscale and save your work.

[Animating]

5) Use the animation Node group to bring your image/sketch to life, connect and unmute the Animation node group to enable image to video if it's not already.

6) Once you have all of your setting and sketch correct, you can go back to the Sketch to image group node and change the seed of the 1st Ksampler to get a different variation of the same sketch

7)Last but not least, Enjoy and have fun. This workflow was really fun to create, can't wait to see what amazing sketches/designs you guys come up with.


                                 Keywords to help your sketches:

Add these key words to your sketch prompt from better results.

closeup, portrait, Profile, fullbody

portrait:  close up of a person (portrait picture), characters will render without face covering.

closeup: close up of what you sketched. (person/object). Characters will render with face covering.

Profile:    profile view of the person/object

Enjoy!!  

Discussion

(No comments yet)

Loading...

Author

8
5.5K
102
26.9K

No reviews yet

  • - latest (5 months ago)

Primitive Nodes (7)

Note (1)

Reroute (6)

Custom Nodes (35)

AlekPet/ComfyUI_Custom_Nodes_AlekPet

  • - PainterNode (1)

ComfyUI

  • - VideoLinearCFGGuidance (1)

  • - SaveAnimatedWEBP (1)

  • - KSampler (3)

  • - VAEDecode (3)

  • - ImageInvert (1)

  • - ImageScale (1)

  • - SaveImage (1)

  • - PreviewImage (3)

  • - LoraLoader (1)

  • - ImageToMask (1)

  • - InpaintModelConditioning (1)

  • - ConditioningCombine (1)

  • - CLIPTextEncode (3)

  • - VAEEncode (1)

  • - SVD_img2vid_Conditioning (1)

  • - CheckpointLoaderSimple (1)

  • - ImageOnlyCheckpointLoader (1)

  • - ImageBatch (2)

  • - ImageUpscaleWithModel (2)

  • - UpscaleModelLoader (1)

  • - SetMetadataForSaveVideo [n-suite] (1)

  • - SaveVideo [n-suite] (1)

  • - ReverseImageBatch (2)

Checkpoints (2)

dreamshaperXL_v21TurboDPMSDE.safetensors

svd_xt_1_1.safetensors

LoRAs (1)

OilPaint.safetensors