My stuff

  • My Workflows

  • Liked Workflows

  • Following Workflows

Go to OpenArt main site
Upload workflow

TOON-ADCTRL-LINE2VIDEO

5.0

0 reviews
24
5.3K
729
4
Description

4step>

CN:

1.使用SD/MJ生成一些具有连续性的静态帧/分镜

2.使用TOONCRAFTER去做图与图直接的动画插值然后合并

3.合并后的视频预处理得到不错的黑白线稿动画

4.使用IPADAPTER+SD15CN:SPARSECTRL scribbile+scribble+AD V3运动模型进行渲染

EN:

1.use MJ/SD IMAGE ON(Get some coherent image)

2.use dynamicrafter-tooncrafter > to get image+image=animation

3.ANIMATION PROCESS TO GET LINEART ANIMATION

4.USE IPADAPTER+SD15CN:sparsectrl scribble + scribble cn + AD V3 motion model render

更新记录update record:

当前版本V4-current wf version:V4

1.修正了image resize节点更新后的设置,且需要更新tooncrafter节点 -fix the node"image resize" setting after updated, then need to update node "dynamicrafter" by kijai

2.修正了英文版注释-fix the EN exegesis,  

3.增加了2.1clip对tooncrafter的支持和clipvison等加速2倍生成,且显存降低质量提升,10s内仅需10GB显存内就可以生成质量不错的16帧插值动画-ADD 2.1clip with tooncrafter and Accelerate the generation effect by two times, reduce the GPU VRAM memory and improve the quality.(now can generate 16frames in 10s with 10GB vram to me)

4.补充了部分区域的使用说明和注释及vram需求,修正ipadapter的权重并添加注释-Added usage instructions and comments for some areas, as well as VRAM requirements. Corrected the weights of the IP adapter and added comments.

5.增加了新的演示-ADD A NEW EXAMPLE SHOWCASE

6.WORKFLOW默认下载为中文版,英文注释请移步discord社区下载-The default download for WORKFLOW is in Chinese version. For English comments, please visit the Discord community to download.

贡献:DREX KIJAI


待开发:除LINE之外的OPEN POSE等其他类型插值AD渲染工作流

Discussion

(No comments yet)

Loading...

Author

3
1.4K
25
10.6K
    X3.png (259.2 kB)
    X7.png (216.1 kB)
    X6.png (223 kB)
    X5.png (212.9 kB)
    best_quality,_an_anime_scene,_stable_mot.mp4 (296.1 kB)
    X4.png (247.6 kB)
    AnimateDiff_00131.gif (9.5 MB)
    line(example.mp4 (1.9 MB)
    AnimateDiff_00134.gif (11.9 MB)
    X1.png (263.5 kB)

No reviews yet

  • - latest (2 years ago)

  • - v20240604-081656

  • - v20240602-175722

  • - v20240602-145211

  • - v20240602-103635

Primitive Nodes (34)

DownloadAndLoadCLIPModel (1)

DownloadAndLoadCLIPVisionModel (1)

DownloadAndLoadDynamiCrafterModel (1)

Fast Groups Bypasser (rgthree) (1)

GetNode (7)

Note Plus (mtb) (12)

Reroute (1)

Seed (rgthree) (2)

SetNode (7)

ToonCrafterInterpolation (1)

Custom Nodes (89)

AnimateDiff Evolved

  • - ADE_ApplyAnimateDiffModel (1)

  • - ADE_LoadAnimateDiffModel (1)

  • - ADE_AnimateDiffSamplingSettings (1)

  • - ADE_StandardStaticContextOptions (1)

  • - ADE_UseEvolvedSampling (1)

ComfyUI

  • - CLIPTextEncode (5)

  • - InvertMask (1)

  • - LoraLoaderModelOnly (5)

  • - SetLatentNoiseMask (1)

  • - LatentBatchSeedBehavior (1)

  • - CLIPSetLastLayer (1)

  • - VAEEncode (1)

  • - PreviewImage (4)

  • - VAEDecode (2)

  • - LoadImage (4)

  • - VAELoader (2)

  • - CheckpointLoaderSimple (1)

  • - ImageUpscaleWithModel (1)

  • - UpscaleModelLoader (1)

  • - DifferentialDiffusion (1)

  • - CLIPVisionLoader (1)

  • - PatchModelAddDownscale (1)

  • - ControlNetLoader (1)

  • - KSampler (1)

  • - ImageResize+ (7)

  • - RIFE VFI (1)

  • - FILM VFI (1)

  • - PixelPerfectResolution (1)

  • - Scribble_XDoG_Preprocessor (1)

  • - IPAdapterBatch (1)

  • - IPAdapterUnifiedLoader (1)

  • - PrepImageForClipVision (2)

  • - ACN_AdvancedControlNetApply (2)

  • - ACN_SparseCtrlLoaderAdvanced (1)

  • - ACN_SparseCtrlSpreadMethodNode (1)

  • - DynamiCrafterModelLoader (1)

  • - BRIAAI Matting (2)

  • - VHS_VideoCombine (8)

  • - VHS_LoadVideo (6)

  • - VHS_MergeImages (5)

  • - ImageResizeKJ (2)

  • - ImageBatchMulti (1)

  • - ConditioningSetMaskAndCombine (1)

  • - INTConstant (4)

Checkpoints (1)

mistoonAnime_v20.safetensors

LoRAs (5)

PCM\pcm_sd15_normalcfg_8step.safetensors

SDXLrender_v2.0.safetensors

detailSliderALT2.safetensors

sd_v15_dpo_lora_v1.safetensors

smooth_lora.safetensors