My stuff

  • My Workflows

  • Liked Workflows

  • Following Workflows

Go to OpenArt main site
Upload workflow

Effecient-3D-Character-Animation

5.0

0 reviews
3
2.4K
160
3
Description

This research presents a novel workflow for 3D character animation using pose estimation. Due to resource constraints, the workflow leverages OpenPose, a less resource-intensive alternative to DWPose, for motion capture. Similarly, SD1.5 models were used instead of the more demanding SDXL models. The workflow also incorporates IPAdapter for input handling and AnimateDiff for animation generation. Despite these compromises, the system was tested with eight combinations of motion modules and steps of ksampler, some with LCM and some without, demonstrating its efficacy in animating user-specified characters based on the user’s motion. This research contributes to the field of 3D character animation by providing a user-friendly and efficient method for character animation, even under resource constraints. Future work includes the development of a website as a wrapper for the workflow, enhancing its accessibility and practical application.

Discussion

(No comments yet)

Loading...

Author

1
160
3
2.4K

No reviews yet

  • - latest (a year ago)

Primitive Nodes (6)

PrepImageForInsightFace (3)

PrimitiveNode (3)

Custom Nodes (43)

AnimateDiff Evolved

  • - ADE_AnimateDiffUniformContextOptions (1)

  • - ADE_AnimateDiffLoaderWithContext (1)

ComfyUI

  • - KSampler (1)

  • - SaveImage (1)

  • - PreviewImage (5)

  • - ControlNetApplyAdvanced (1)

  • - CheckpointLoaderSimple (1)

  • - VAEDecode (1)

  • - ImageBatch (4)

  • - CLIPTextEncode (2)

  • - ImageScale (1)

  • - LoadImage (3)

  • - LoraLoader (1)

  • - CLIPVisionLoader (1)

  • - VAEEncode (1)

  • - OpenposePreprocessor (1)

  • - WD14Tagger|pysssss (1)

  • - IPAdapterBatch (1)

  • - PrepImageForClipVision (3)

  • - IPAdapterEncoder (3)

  • - IPAdapterAdvanced (1)

  • - IPAdapterCombineEmbeds (1)

  • - IPAdapterModelLoader (1)

  • - IPAdapterEmbeds (1)

  • - ControlNetLoaderAdvanced (1)

  • - VHS_LoadImagesPath (1)

  • - VHS_LoadVideoPath (1)

  • - VHS_VideoCombine (1)

  • - VHS_LoadVideo (1)

Checkpoints (1)

epicrealism_naturalSinRC1VAE.safetensors

LoRAs (1)

LCM_LoRA_Weights_SD15.safetensors