Template for prompt travel + openpose controlnet

5.0

2 reviews
394
91.0K
31.7K
28
Description

This is used just as a reference for prompt travel + controlnet animations

Motion controlnet:  https://huggingface.co/crishhh/animatediff_controlnet/resolve/main/controlnet_checkpoint.ckpt?download=true

Node Diagram
Discussion
A
Adereka year ago

Very good job! TY :)

But... to find all needed files it was terrible...

D
Damien Benoita year ago

what model is needed for #34 the ad/motion.ckpt ?

👍7

Amazing workflow!  Can you share the input video used to drive the workflow?   Would like to compare input with derived output.

👍3
y
yngen eera year ago

@matt3o can you please share the motion gif/mp4 to let us start from the exact point 0 ? >>>> oh man!! Im dumb as a brick! hahah, literaly I just went to smoke a cigarette after posting this and than the flash from the clear sky cames! hhahah, for that one above me, don't take it too seriously with that 'dumb as brick' please.... all u must to do is to click that gif above to expand , than right click and save as... ;-) than go to ezgif page and transfer it into mp4

(Edited)
S
Sign Uppa year ago

Does anyone know how to solve DWPreprocessor: Connection error, and we cannot find the requested files in the disk cache. This keeps coming up

yeah same, is there a way to do it uploading the video with the LoadVideo(path)??


🙏1

Apparently, it's all about the assembly of ComfyUI. I had the same problem, and the updates to ComfyUI via Manager did not help. Then I just re-installed ComfyUI using the Pinokio neural network automatic installation service, and everything worked:)

I changed the prompt to be set in the city (instead of sea), but unfortunately it's not keeping background consistent, so buildings changing and disappearing, etc. through the entire clip.   Any recommendations for better maintaining background?

q
qi yia year ago

Great workflow, does this model only produce videos with no more than 32 frames?

R
Robin Hoesea year ago

What is the difference of the 2 prompt boxes in the Batch Prompt Schedule node (under the one where you set the frames)? It doesn't look like it's using negative prompts

s
sungho janga year ago

Very Good! bro!!

A
Akshay Dixit10 months ago

Best workflow for animatediff

s
shshsh10 months ago

I keep getting error for the upload video path

潘正源10 months ago

我理解这个工作流是将一个图片转换成动图,但为什么需要我上传一个mp4文件?不应该是上传图片吗

I understand that this workflow involves converting an image into an animated GIF, but why do I need to upload an MP4 file? Shouldn’t it be an image upload instead?

J
Juan Jimenez10 months ago

This is vidtovid not imagetovid

W
Wdy W9 months ago

could not be loaded with cv.

this problem has been solved,It's because of/and\, not because of plug-in error.


(Edited)

hi nice job, what is the motion.ckpt you use on the controlnet model? thanks


J
Johan Wiklund8 months ago

i wonder this also :)

S
Shahab Vahidi8 months ago

Using artificial intelligence can be very helpful to help different stages of film or animation. Here are some free or free artificial intelligence tools that can help you in the process:

U
UuU7 months ago

Keep finding error in Ksampler? Why? I follow all the models and error at the Ksampler~

U
UuU7 months ago

I find out it may happen to your comfy UI manager, and proper installation of animatediff & animatediff advancer nodes


ogbitus6 months ago

File "C:\Users\MSI\Desktop\ComfyUI_windows_portable\ComfyUI\execution.py", line 152, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\MSI\Desktop\ComfyUI_windows_portable\ComfyUI\execution.py", line 82, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\MSI\Desktop\ComfyUI_windows_portable\ComfyUI\execution.py", line 75, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\MSI\Desktop\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-AnimateDiff-Evolved\animatediff\nodes_gen1.py", line 146, in load_mm_and_inject_params motion_model = load_motion_module_gen1(model_name, model, motion_lora=motion_lora, motion_model_settings=motion_model_settings) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\MSI\Desktop\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-AnimateDiff-Evolved\animatediff\model_injection.py", line 1242, in load_motion_module_gen1 mm_state_dict = comfy.utils.load_torch_file(model_path, safe_load=True) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\MSI\Desktop\ComfyUI_windows_portable\ComfyUI\comfy\utils.py", line 14, in load_torch_file if ckpt.lower().endswith(".safetensors") or ckpt.lower().endswith(".sft"): ^^^^^^^^^^

yudaoxiong3 months ago

为什么我换成自己的视频后,生成的视频闪瞎眼

Author

16
51.5K
2.1K
235.3K

Reviews

t

tailong jin

10 months ago

what is the second controlnet name?is it for motion smooth?

d

dreammagicarts

a year ago

Awesome

Versions (1)

  • - latest (a year ago)

Primitive Nodes (1)

PrimitiveNode (1)

Custom Nodes (23)

  • - ADE_AnimateDiffLoaderWithContext (1)

  • - ADE_AnimateDiffUniformContextOptions (1)

ComfyUI

  • - VAEDecode (2)

  • - CheckpointLoaderSimple (1)

  • - EmptyLatentImage (1)

  • - VAELoader (1)

  • - CLIPTextEncode (1)

  • - FreeU_V2 (1)

  • - ControlNetApplyAdvanced (2)

  • - KSampler (2)

  • - LoraLoaderModelOnly (1)

  • - ImageCASharpening+ (1)

  • - ControlNetLoaderAdvanced (2)

  • - VHS_VideoCombine (2)

  • - VHS_LoadVideoPath (1)

  • - BatchPromptSchedule (1)

Checkpoints (1)

sd15/dreamshaper_8.safetensors

LoRAs (1)

v3_sd15_adapter.ckpt