Toon crafter workflow

5.0

2 reviews
50
12.7K
2.0K
12
Description

Hi everyone,

This is a basic default Toon Crafter workflow. When you want to utilize Toon Crafter, you should not rely completely on the workflow. Here’s a step-by-step guide to creating a animation:

1. Create Keyframes

First, you need to make keyframes for Toon Crafter. This is the main step for creating the animation. I started by doing four poses in a 3D software. You can use Blender, or if you don’t know how to use 3D software, you can create the keyframes using other methods, like shooting yourself on camera and extracting the keyframes.

2. Generate Depth Map and Canny Edge

After creating these four poses, I generated a depth map and a canny edge.

3. Create Spritesheet

After generating the spritesheet, use this canny and depth spritesheet as a ControlNet input in Text-to-Image and generate the final frames. This ensures a consistent character when generating in a single batch inside Stable Diffusion.

After 2-3 generations i got this image:

4. Slice Spritesheet

I sliced the spritesheet using (Sprite sheet slicer) and selected only two frames (1st and 4th frames) due to the VRAM problem—my PC has only 12GB VRAM.

5. Composite with Background and Foreground

I composited it with a background and a crate in the foreground using Photopea website (free).


6. Finalize Animation

Finally, I used these two keyframes inside the Toon Crafter workflow. After 2-3 generations, I got this result.

Following this organized workflow will help you create smooth and consistent animations using Toon Crafter.

Node Diagram
Discussion

how to create the spritesheet?


a
ai_wifus9 months ago

You can upload the images to this website to generate the spritesheet.

https://www.codeandweb.com/free-sprite-sheet-packer

thanks!

g
gkain9 months ago

👍👍👍

❤️1
x
xulzy9 months ago

I hope the teacher can make a related video step teaching, I will become your loyal YouTube fan

👍1
a
ai_wifus9 months ago

I'll let you know when I post the step-by-step video tutorial. Thank you!

(Edited)
韩春辉9 months ago


Error occurred when executing ToonCrafterInterpolation:  "compute_indices_weights_aa" not implemented for 'Half'

how to fix? thanks

a
ai_wifus9 months ago

configure all the options to use FP16.

a
ai_wifus9 months ago

use this model:  https://huggingface.co/Kijai/DynamiCrafter_pruned/resolve/main/tooncrafter_512_interp-fp16.safetensors?download=true

(Edited)
韩春辉9 months ago

i am sure i use all the options are fp16,but the error always exsist,same warn

무너님9 months ago

Canny and depth map spritesheet could you please tell me how to make the same character? I appreciate if you have a workflow as well.

k
kdash9 months ago

yeh same, id like to know how to link the spritesheet " as a ControlNet input in Text-to-Image" ? thanks a lot!

Author

1
2.0K
50
12.7K

Resources (4)

    depth.png (1 MB)
    fox_3.png (213.9 kB)
    fox_0.png (207.2 kB)
    canny.png (118 kB)

Reviews

H

Human Culture

a month ago

needs some hack for lowvram but it works

Fantastic guide! Absolutely brilliant.

Versions (1)

  • - latest (9 months ago)

Primitive Nodes (6)

DownloadAndLoadCLIPModel (1)

DownloadAndLoadCLIPVisionModel (1)

DownloadAndLoadDynamiCrafterModel (1)

Reroute (1)

ToonCrafterDecode (1)

ToonCrafterInterpolation (1)

Custom Nodes (11)

ComfyUI

  • - CLIPTextEncode (2)

  • - LoadImage (3)

  • - VHS_VideoCombine (1)

  • - GetImageSizeAndCount (1)

  • - ImageResizeKJ (3)

  • - ImageBatchMulti (1)

Checkpoints (0)

LoRAs (0)