OpenArt
OpenArt
Workflows
Go to OpenArt main site
Upload workflow

LivePortrait + AnimateDiff backgrounds V 0.2

5.0

1 reviews
30
8.3K
1.7K
8
Description

Easy workflow to create animatediff based animation with a Liveportrait. Create a nice prompt, select the subject that should be segmented and let this workflow do the rest.

Open this workflow, use Comfyui manager to download the missing nodes and you should be good to go. There are a few models needed for Controlnet but you can use this workflow without them

Node Diagram
Discussion
R
R.C KING8 months ago

Exception during processing!!! ClipVision model not found.

Traceback (most recent call last):

 File "E:\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute

   output_data, output_ui = get_output_data(obj, input_data_all)

                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

 File "E:\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data

   return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)

                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

 File "E:\ComfyUI_windows_portable\ComfyUI\execution.py", line 74, in map_node_over_list

   results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))

                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

 File "E:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_IPAdapter_plus\IPAdapterPlus.py", line 511, in load_models

   raise Exception("ClipVision model not found.")

Exception: ClipVision model not found.

this error shows

my ipadapter unified loader node not working

n
neofuturist8 months ago

Make sure to use Comfyui manager and use it to download all the models you can find that are needed for IpAdapter, it will work nicely after

R
R.C KING8 months ago

i did it and please open your workflow there is a new issue becouse live portrait node is update so thare is bug

R
R.C KING8 months ago

just run your workflow you will understand

see this

`Loading 1 new model
LivePortrait using fp16
Load appearance_feature_extractor done.
Load motion_extractor done.
Load warping_module done.
Load spade_generator done.
Load stitching_retargeting_module done.
!!! Exception during processing!!! LivePortraitProcess.process() missing 1 required positional argument: 'crop_info'
Traceback (most recent call last):
File "E:\ComfyUI_windows_portable\ComfyUI\execution.py", line 152, in recursive_execute
output_data, output_ui = get_output_data(obj, input_data_all)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\ComfyUI_windows_portable\ComfyUI\execution.py", line 82, in get_output_data
return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\ComfyUI_windows_portable\ComfyUI\execution.py", line 75, in map_node_over_list
results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
TypeError: LivePortraitProcess.process() missing 1 required positional argument: 'crop_info'

Prompt executed in 23.44 seconds`

n
neofuturist8 months ago

Just pushed a new version, let me know if it works

R
R.C KING8 months ago

bro you need to update your work flow becouse in workflow live portrait process node is upgrade and now its not working

error says crop info missing

can you fix that please and uplode now fix workflow

R
R.C KING8 months ago

ok thanks i see the new workflow let me try that

R
R.C KING8 months ago

problem start when update live portrait so please update to new version and run your workflow you will see this same error and if you find solution please make new workflow and share with all setting so i can understand and run this workflow

thanks in advance

Author

n

neofuturist

3
8.9K
85
31.2K

Resources (5)

    260724_liveportrait_Animate.json (166.2 kB)
    LP_AD__00092.mp4 (1.7 MB)
    LP_AD_Blend_00061.mp4 (402.2 kB)
    LP_AD_Blend_00076.mp4 (2.6 MB)
    LP_AD_UPSCALED_00007.mp4 (12.1 MB)

Reviews

R

R.C KING

8 months ago

I ran this workflow and it is amazing, truly nice and easy you need a correct model to run through this.. thanks bro for updating this... make another if you have time and please make on longer stable video making workflow

Versions (2)

  • - latest (8 months ago)

  • - v20240721-083241

Primitive Nodes (46)

DepthAnythingV2Preprocessor (1)

DownloadAndLoadLivePortraitModels (1)

Fast Groups Bypasser (rgthree) (1)

ImageConcatMulti (1)

LivePortraitComposite (1)

LivePortraitCropper (2)

LivePortraitLoadCropper (1)

LivePortraitLoadMediaPipeCropper (1)

LivePortraitProcess (1)

LivePortraitRetargeting (1)

Note (14)

PrimitiveNode (2)

Reroute (19)

Custom Nodes (97)

AnimateDiff Evolved

  • - ADE_LoopedUniformContextOptions (1)

  • - ADE_AnimateDiffLoaderGen1 (1)

ComfyUI

  • - LoraLoader (2)

  • - VAEEncode (2)

  • - VAEDecode (3)

  • - ControlNetApplyAdvanced (2)

  • - KSampler (2)

  • - ImageUpscaleWithModel (3)

  • - ImageScaleBy (2)

  • - CLIPTextEncode (4)

  • - CheckpointLoaderSimple (2)

  • - TomePatchModel (1)

  • - EmptyLatentImage (2)

  • - GrowMask (1)

  • - UpscaleModelLoader (3)

  • - PreviewImage (5)

  • - MaskToImage (1)

  • - LoadImage (1)

  • - SaveImage (1)

  • - KSamplerAdvanced (1)

ComfyUI Easy Use

  • - easy cleanGpuUsed (7)

  • - easy imageSize (5)

ComfyUI Essentials

  • - MaskBlur+ (1)

  • - ImageDesaturate+ (1)

  • - ImageCompositeFromMaskBatch+ (1)

  • - MaskPreview+ (1)

ComfyUI Impact Pack

  • - SAMLoader (1)

ComfyUI_IPAdapter_plus

  • - IPAdapterUnifiedLoader (1)

  • - IPAdapterTiled (1)

ComfyUI-Advanced-ControlNet

  • - ControlNetLoaderAdvanced (2)

ComfyUI-Chibi-Nodes

  • - Textbox (3)

ComfyUI-Logic

  • - Int (1)

ComfyUI-VideoHelperSuite

  • - VHS_VideoCombine (9)

  • - VHS_VideoInfo (2)

  • - VHS_LoadVideo (2)

Dream Video Batches

  • - Unwrap Frame Set [DVB] (1)

  • - Linear Camera Zoom [DVB] (2)

  • - Create Frame Set [DVB] (1)

  • - Sine Camera Pan [DVB] (1)

  • - Sine Camera Zoom [DVB] (1)

  • - Linear Camera Pan [DVB] (1)

KJNodes for ComfyUI

  • - GrowMaskWithBlur (1)

  • - CreateShapeMask (1)

  • - GetImageSizeAndCount (4)

  • - ImageResizeKJ (2)

pythongosssss/ComfyUI-Custom-Scripts

  • - ConstrainImage|pysssss (1)

Quality of life Suit:V2

  • - Text _O (1)

segment anything

  • - GroundingDinoSAMSegment (segment anything) (1)

  • - GroundingDinoModelLoader (segment anything) (1)

Checkpoints (2)

sd15\level4_v50BakedVAEFp16.safetensors

sdxlTurbo\level4XL_alphaV03.safetensors

LoRAs (2)

AnimateLCM_sd15_t2v_lora.safetensors

uum4ns_01.safetensors