All Your Life 你一生的故事
4.0
3 reviewsDescription
Table of Contents
《All Your Life 》
你一生的故事,上传一张照片获得从童年到老年的渐变肖像视频。仅适用RIFE-VFI的补帧实现动画,并没有AnimateDiff。
提供 写实照片 和 铅笔素描 的两个版本。你可以在附件中找到两个版本的json文件:
All You Life-Photo照片版-Rui.json
All You Life-Sketch素描版-Rui.json
————————
6月4号更新,将Logo环节移至流程末端,从而避免logo在补间动画时产生抖动。(感谢datou的建议)
Updated on 4 June to move the Logo link to the end of the process, thus avoiding logo jitter during fill-in animation.(Thanks to datou for the suggestion!)
————————
All Your Life , upload a photo to get a gradient portrait video from childhood to old age. Only RIFE-VFI's frame-filling implementation of animation applies, and there is no AnimateDiff.
Available in both photo-realistic and pencil sketch versions.
You can find both versions of the json file in the attachment.
为了获得一样的制作效果,最好使用相同的模型和参数。
需要用到的素材都上传到附件了。
祝大家玩得开心:)
In order to get the same production effect, it is better to use the same model and parameters.
The materials you need to use are uploaded in the attachment.
Have fun :)
——————
CKPT:
https://civitai.com/models/133005?modelVersionId=357609
StyleAligned:
https://github.com/brianfitzgerald/style_aligned_comfy
PT-Lora:
https://sliders.baulab.info/weights/xl_sliders/professional.pt
Pencil Drawing-Lora:
https://civitai.com/models/132383
VLM:
https://github.com/gokayfem/ComfyUI_VLM_nodes
Openpose-ControlNet:
https://huggingface.co/thibaud/controlnet-openpose-sdxl-1.0/resolve/main/control-lora-openposeXL2-rank256.safetensors
InstantID:
https://github.com/cubiq/ComfyUI_InstantID
Fizz:
https://github.com/FizzleDorf/ComfyUI_FizzNodes
BGMusic:
ForeverYoung-Alphaville
Node Diagram
Discussion
麥克的視頻中間有糊成一團的狀況,要如何解決?
因为帧数过少,补间过渡太急造成的。可以把帧数扩充1倍。目前画了8张,画16张能降低补间出错的问题:)
好的,我試試 ,很棒的工作流。
但是使用AI去辨別性別這出發點是很好,不過有些人物會辨別成相反性別,比如野獸前輩(AI判定為female)..
嗯,这部分要靠VLM模型的能力,不能做到100%正确。你也可以把性别判定模块改成手动输入Male和Female来实现人工判定:)
我也发现这里有点不准确, 后来我就把这段去了, 根据图片手动决定是用Female还是Male
I would like to ask how to change the gender determination? Can I directly enter male or female?
I would like to ask how to change the gender determination? Can I directly enter male or female?
I encountered this issue while running this workflow, please help me:执行 BatchPromptSchedule 时出错:元组索引超出范围 文件“D:\ComfyUI-aki-v1.1\execution.py”,第 151 行,在 recursive_execute output_data 中,output_ui = get_output_data(obj, input_data_all) 文件“D:\ComfyUI-aki-v1.1\execution.py”,第 81 行,在 get_output_data 中 return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) 文件“D:\ComfyUI-aki-v1.1\execution.py”,第 74 行,在 map_node_over_list 中 results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) 文件“D:\ComfyUI-aki-v1.1\custom_nodes\ComfyUI_FizzNodes\ScheduledNodes.py”, 第 156 行, 在 animate return batch_prompt_schedule(settings, clip) 文件“D:\ComfyUI-aki-v1.1\custom_nodes\ComfyUI_FizzNodes\ScheduleTypes.py”, 第 56 行, 在 batch_prompt_schedule p = BatchPoolAnimConditioning(pos_cur_prompt, pos_nxt_prompt, weight, clip, ) 文件“D:\ComfyUI-aki-v1.1\custom_nodes\ComfyUI_FizzNodes\BatchFuncs.py”, 第 325 行, 在 BatchPoolAnimConditioning interpolated_conditioning = addWeighted([[cond_to, {"pooled_output": pooled_to}]], 文件“D:\ComfyUI-aki-v1.1\custom_nodes\ComfyUI_FizzNodes\ScheduleFuncs.py”,第 90 行,在 addWeighted 中 pooled_output_to = pad_with_zeros(pooled_output_to, max_size) 文件“D:\ComfyUI-aki-v1.1\custom_nodes\ComfyUI_FizzNodes\ScheduleFuncs.py”,第 110 行,在 pad_with_zeros 中 padding = torch.zeros(tensor.shape[0], target_length - current_length, tensor.shape[2]).to(tensor.device)
日志报错:Warning: ImageBlend mask mismatch, dropped!
与此同时,生成的视频上半部分是黑色的
Error occurred when executing ApplyInstantID: 'NoneType' object has no attribute 'copy' File "F:\ComfyUI-aki-v1.3\ComfyUI-aki-v1.3\execution.py", line 151, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) File "F:\ComfyUI-aki-v1.3\ComfyUI-aki-v1.3\execution.py", line 81, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) File "F:\ComfyUI-aki-v1.3\ComfyUI-aki-v1.3\execution.py", line 74, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) File "F:\ComfyUI-aki-v1.3\ComfyUI-aki-v1.3\custom_nodes\ComfyUI_InstantID\InstantID.py", line 383, in apply_instantid c_net = control_net.copy().set_cond_hint(face_kps.movedim(-1,1), cn_strength, (start_at, end_at))
请问下这是什么原因?
还有就是我LLAVA模型都下好了,但就是卡在LLAVA采样器不动,后来我直接不用了,用ollama来获取图片信息了,不知道是否可以
这个问题怎么解啊?
When loading the graph, the following node types were not found:
- GetNode
- Image scale to side
- SetNodeNodes that have failed to load will show as red on the graph.
Error occurred when executing InstantIDFaceAnalysis: File "F:\Programs\Pinokio\api\comfyui.git\app\execution.py", line 151, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) File "F:\Programs\Pinokio\api\comfyui.git\app\execution.py", line 81, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) File "F:\Programs\Pinokio\api\comfyui.git\app\execution.py", line 74, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) File "F:\Programs\Pinokio\api\comfyui.git\app\custom_nodes\ComfyUI_InstantID\InstantID.py", line 217, in load_insight_face model = FaceAnalysis(name="antelopev2", root=INSIGHTFACE_DIR, providers=[provider + 'ExecutionProvider',]) # alternative to buffalo_l File "F:\Programs\Pinokio\api\comfyui.git\app\env\lib\site-packages\insightface\app\face_analysis.py", line 43, in __init__ assert 'detection' in self.models
How to fix it?
please help me with this error! thanks
Error occurred when executing ApplyInstantID: Reference Image: No face detected. File "/content/drive/MyDrive/ComfyUI/execution.py", line 152, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) File "/content/drive/MyDrive/ComfyUI/execution.py", line 82, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) File "/content/drive/MyDrive/ComfyUI/execution.py", line 75, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) File "/content/drive/MyDrive/ComfyUI/custom_nodes/ComfyUI_InstantID/InstantID.py", line 290, in apply_instantid raise Exception('Reference Image: No face detected.')
Error occurred when executing LayerUtility: ImageBlend: images do not match File "C:\ComfyUI_Cash_Cow_portable\ComfyUI\execution.py", line 316, in execute output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\ComfyUI_Cash_Cow_portable\ComfyUI\execution.py", line 191, in get_output_data return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\ComfyUI_Cash_Cow_portable\ComfyUI\execution.py", line 168, in _map_node_over_list process_inputs(input_dict, i) File "C:\ComfyUI_Cash_Cow_portable\ComfyUI\execution.py", line 157, in process_inputs results.append(getattr(obj, func)(**inputs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\ComfyUI_Cash_Cow_portable\ComfyUI\custom_nodes\ComfyUI_LayerStyle\py\image_blend.py", line 72, in image_blend _canvas.paste(_comp, mask=_mask) File "C:\ComfyUI_Cash_Cow_portable\python_embeded\Lib\site-packages\PIL\Image.py", line 1847, in paste self.im.paste(im, box, mask.im)
一直卡在这里,哪位老师能给指点一下?就是加载遮罩图片mask.png的这个节点。前面的图片生成流程都走完了,到这里就过不去了。
很痛苦,折腾了很久,不知道该怎么办。
# ComfyUI Error Report
## Error Details
- **Node Type:** KSampler (Efficient)
- **Exception Type:** RuntimeError
- **Exception Message:** mat1 and mat2 shapes cannot be multiplied (256x2048 and 768x320)
## Stack Trace
how to solve this problem
great effort thanks
Node Details
Primitive Nodes (15)
Anything Everywhere (2)
Anything Everywhere3 (1)
Display Any (rgthree) (1)
GetNode (5)
Image scale to side (2)
Note (1)
SetNode (3)
Custom Nodes (45)
ComfyUI
- ControlNetLoader (2)
- LoadImage (4)
- ControlNetApplyAdvanced (1)
- EmptyLatentImage (1)
- CheckpointLoaderSimple (1)
- LoraLoaderModelOnly (2)
- PreviewImage (1)
- easy compare (1)
- RIFE VFI (1)
- InstantIDModelLoader (1)
- InstantIDFaceAnalysis (1)
- ApplyInstantID (1)
- LayerUtility: ImageBlend (2)
- ImageGenResolutionFromImage (1)
- AIO_Preprocessor (1)
- VHS_VideoCombine (1)
- VHS_LoadAudio (1)
- KSampler (Efficient) (1)
- BatchPromptSchedule (1)
- ShowText|pysssss (3)
- Text _O (4)
- Concat Text _O (2)
- Replace Text _O (1)
- StyleAlignedBatchAlign (1)
- LlavaClipLoader (1)
- LLava Loader Simple (1)
- LLavaSamplerSimple (2)
- SimpleText (2)
- ViewText (1)
- Text Input Switch (1)
- Image Filter Adjustments (1)
Model Details
Checkpoints (1)
SDXL\juggernautXL_v9Rdphoto2Lightning.safetensors
LoRAs (2)
PT滑块\professional专业感.pt
SDXL-Style\PE_PencilDrawing.safetensors