Use the new ToonCrafter custom-node to create an animation of your choice... You have UNTIL June 23th to participate! Info on the #Challenges Discord Channel. Prize: $50 PayPal Credit! 

ToonCrafter Workflow Challenge !!

ai_wifus

Hi everyone,This is a basic default Toon Crafter workflow. When you want to utilize Toon Crafter, you should not rely completely on the workflow. Here’s a step-by-step guide to creating a animation:<h3>1. Create Keyframes</h3>First, you need to make keyframes for Toon Crafter. This is the main step for creating the animation. I started by doing four poses in a 3D software. You can use Blender, or if you don’t know how to use 3D software, you can create the keyframes using other methods, like shooting yourself on camera and extracting the keyframes.<img src="https://cdn.openart.ai/wangeditor_uploads/HWYOY7au6gUNh5U484jo/compressed/image_t5_GKwKA_1719117800651_512.webp" alt="" data-href="" style="width: 282.00px;height: 187.42px;"/><img src="https://cdn.openart.ai/wangeditor_uploads/HWYOY7au6gUNh5U484jo/compressed/image_dTMvTAF1_1719117836278_512.webp" alt="" data-href="" style="width: 283.00px;height: 189.52px;"/><h3>2. Generate Depth Map and Canny Edge</h3>After creating these four poses, I generated a depth map and a canny edge.<img src="https://cdn.openart.ai/wangeditor_uploads/HWYOY7au6gUNh5U484jo/compressed/image_0MjgZ1NI_1719117910649_512.webp" alt="" data-href="" style="width: 410.00px;height: 259.13px;"/><img src="https://cdn.openart.ai/wangeditor_uploads/HWYOY7au6gUNh5U484jo/compressed/image_sbHS0X0h_1719117960792_512.webp" alt="" data-href="" style="width: 416.00px;height: 260.00px;"/><h3>3. Create Spritesheet</h3>After generating the spritesheet, use this canny and depth spritesheet as a ControlNet input in Text-to-Image and generate the final frames. This ensures a consistent character when generating in a single batch inside Stable Diffusion.<img src="https://cdn.openart.ai/wangeditor_uploads/HWYOY7au6gUNh5U484jo/compressed/image_TPpbPi5s_1719118173527_512.webp" alt="" data-href="" style="width: 389.00px;height: 243.13px;"/><img src="https://cdn.openart.ai/wangeditor_uploads/HWYOY7au6gUNh5U484jo/compressed/image_j3hnYNbR_1719118175643_512.webp" alt="" data-href="" style="width: 390.00px;height: 243.75px;"/>After 2-3 generations i got this image:<img src="https://cdn.openart.ai/wangeditor_uploads/HWYOY7au6gUNh5U484jo/compressed/image_e_36IZod_1719118453317_512.webp" alt="" data-href="" style=""/><h3>4. Slice Spritesheet</h3>I sliced the spritesheet using (Sprite sheet slicer) and selected only two frames (1st and 4th frames) due to the VRAM problem—my PC has only 12GB VRAM.<img src="https://cdn.openart.ai/wangeditor_uploads/HWYOY7au6gUNh5U484jo/compressed/image_jZjIIDGl_1719118634733_512.webp" alt="" data-href="" style="width: 435.00px;height: 271.88px;"/><img src="https://cdn.openart.ai/wangeditor_uploads/HWYOY7au6gUNh5U484jo/compressed/image_hTmTfLlI_1719118670387_512.webp" alt="" data-href="" style="width: 433.00px;height: 270.63px;"/><h3>5. Composite with Background and Foreground</h3>I composited it with a background and a crate in the foreground using Photopea website (free).<img src="https://cdn.openart.ai/wangeditor_uploads/HWYOY7au6gUNh5U484jo/compressed/image_5qyhk4ov_1719118734636_512.webp" alt="" data-href="" style=""/><img src="https://cdn.openart.ai/wangeditor_uploads/HWYOY7au6gUNh5U484jo/compressed/image_rxn05sJE_1719118745704_512.webp" alt="" data-href="" style=""/> <h3>6. Finalize Animation</h3>Finally, I used these two keyframes inside the Toon Crafter workflow. After 2-3 generations, I got this result.Following this organized workflow will help you create smooth and consistent animations using Toon Crafter.

Toon crafter workflow

liubai

作用，通过提示词控制眼睛、头发、嘴巴等生成进行眨眼说话的动画 用到的自定义节点：BrushNet：https://github.com/nullquant/ComfyUI-BrushNet?tab=readme-ov-fileSegmentAnything：https://github.com/frantic/comfyui_segment_anythingComfyUI-ToonCrafter：https://github.com/AIGODLIKE/ComfyUI-ToonCrafter 思路：通过seg分割出要改变的动画位置，比如眼睛、嘴巴等通过BrushNet实现对分割出的位置进行重绘通过ToonCrafter进行插帧生成动画 ComfySpace： <a href="https://t.zsxq.com/19H0cfM1O" target="_blank">https://t.zsxq.com/19H0cfM1O</a>

可控动画制作

markury

This is my entry for the ToonCrafter contest here on OpenArt. This is the workflow I started with in the video to loop between 3 keyframes using multiple ToonCrafter samplers. Follow along with my YouTube video to add virtually unlimited length to your ToonCrafter video workflows! Download the 4-image version of the workflow here: <a href="https://www.patreon.com/posts/comfyui-multi-105856838" target="_blank">https://www.patreon.com/posts/comfyui-multi-105856838</a> Check out the YouTube video for this workflow: <a href="https://youtu.be/-Fsl_BvfI18" target="_blank">https://youtu.be/-Fsl_BvfI18</a> <div data-w-e-type="video" data-w-e-is-void>
<video poster="https://media.discordapp.net/attachments/1151651773359075331/1249364169971470396/tooncrafter2.png?ex=6667088e&is=6665b70e&hm=bd0fafe0037d3a76045ba85a4e37de40a5c7a0e90419f81aa734ca3d6d4d1390&=&format=webp&quality=lossless&width=1100&height=618" controls="true" width="auto" height="auto"><source src="https://youtu.be/-Fsl_BvfI18" type="video/mp4"/></video>
</div>

Multi-Frame Interpolation with ToonCrafter

Saurabh Swami

<h1 style="text-indent: 2em; text-align: left;">Swamisaur's ToonKrafter Animation workflow </h1><h1 style="text-indent: 2em; text-align: left;">(GPU Optimised)</h1>All notes included in the file, beginner friendly workflow. Simply add the images and hit Run Upscaled exmple: (upscaeld with <a href="https://www.topazlabs.com/" target="_blank">Topaz</a>)<div data-w-e-type="video" data-w-e-is-void>
<video poster="" controls="true" width="auto" height="auto"><source src="https://cdn.openart.ai/wangeditor_uploads/0dylscskWFtRS8A9lmMt/raw/video_FYYmR_cI_1717866028514_raw.mp4" type="video/mp4"/></video>
</div> Workflow screenshot<img src="https://cdn.openart.ai/wangeditor_uploads/0dylscskWFtRS8A9lmMt/compressed/image_0Nab-bp7_1717866112247_512.webp" alt="" data-href="" style=""/> Reach out at @swamisaur on instagram for any queries or questions

OpenArt

Workflows

Active Sessions

Workflow Challenge- ToonCrafter Workflow Challenge !!
Use the new ToonCrafter custom-node to create an animation of your choice... You have UNTIL June 23th to participate! Info on the #Challenges Discord Channel. Prize: $50 PayPal Credit!
6/7/2024-6/23/2024

Toon crafter workflow

可控动画制作

Multi-Frame Interpolation with ToonCrafter

A beginner friendly workflow with upto 6 images as input. (GPU Optimised)