Effecient-3D-Character-Animation
5.0
0 reviewsDescription
This research presents a novel workflow for 3D character animation using pose estimation. Due to resource constraints, the workflow leverages OpenPose, a less resource-intensive alternative to DWPose, for motion capture. Similarly, SD1.5 models were used instead of the more demanding SDXL models. The workflow also incorporates IPAdapter for input handling and AnimateDiff for animation generation. Despite these compromises, the system was tested with eight combinations of motion modules and steps of ksampler, some with LCM and some without, demonstrating its efficacy in animating user-specified characters based on the user’s motion. This research contributes to the field of 3D character animation by providing a user-friendly and efficient method for character animation, even under resource constraints. Future work includes the development of a website as a wrapper for the workflow, enhancing its accessibility and practical application.
Discussion
(No comments yet)
Loading...
Reviews
No reviews yet
Versions (1)
- latest (a year ago)
Node Details
Primitive Nodes (6)
PrepImageForInsightFace (3)
PrimitiveNode (3)
Custom Nodes (43)
- ADE_AnimateDiffUniformContextOptions (1)
- ADE_AnimateDiffLoaderWithContext (1)
ComfyUI
- KSampler (1)
- SaveImage (1)
- PreviewImage (5)
- ControlNetApplyAdvanced (1)
- CheckpointLoaderSimple (1)
- VAEDecode (1)
- ImageBatch (4)
- CLIPTextEncode (2)
- ImageScale (1)
- LoadImage (3)
- LoraLoader (1)
- CLIPVisionLoader (1)
- VAEEncode (1)
- OpenposePreprocessor (1)
- WD14Tagger|pysssss (1)
- IPAdapterBatch (1)
- PrepImageForClipVision (3)
- IPAdapterEncoder (3)
- IPAdapterAdvanced (1)
- IPAdapterCombineEmbeds (1)
- IPAdapterModelLoader (1)
- IPAdapterEmbeds (1)
- ControlNetLoaderAdvanced (1)
- VHS_LoadImagesPath (1)
- VHS_LoadVideoPath (1)
- VHS_VideoCombine (1)
- VHS_LoadVideo (1)
Model Details
Checkpoints (1)
epicrealism_naturalSinRC1VAE.safetensors
LoRAs (1)
LCM_LoRA_Weights_SD15.safetensors