All Your Life 你一生的故事

4.0

3 reviews
255
36.3K
8.6K
46
Description

Table of Contents

《All Your Life 》

《All Your Life 》

你一生的故事,上传一张照片获得从童年到老年的渐变肖像视频。仅适用RIFE-VFI的补帧实现动画,并没有AnimateDiff。

提供 写实照片 铅笔素描 的两个版本。你可以在附件中找到两个版本的json文件:

All You Life-Photo照片版-Rui.json

All You Life-Sketch素描版-Rui.json

————————

6月4号更新,将Logo环节移至流程末端,从而避免logo在补间动画时产生抖动。(感谢datou的建议)

Updated on 4 June to move the Logo link to the end of the process, thus avoiding logo jitter during fill-in animation.(Thanks to datou for the suggestion!)

————————

All Your Life , upload a photo to get a gradient portrait video from childhood to old age. Only RIFE-VFI's frame-filling implementation of animation applies, and there is no AnimateDiff.

Available in both photo-realistic and pencil sketch versions.

You can find both versions of the json file in the attachment.



为了获得一样的制作效果,最好使用相同的模型和参数。

需要用到的素材都上传到附件了。

祝大家玩得开心:)

In order to get the same production effect, it is better to use the same model and parameters.

The materials you need to use are uploaded in the attachment.

Have fun :)



——————



CKPT:

https://civitai.com/models/133005?modelVersionId=357609


StyleAligned:

https://github.com/brianfitzgerald/style_aligned_comfy


PT-Lora:

https://sliders.baulab.info/weights/xl_sliders/professional.pt


Pencil Drawing-Lora:

https://civitai.com/models/132383


VLM:

https://github.com/gokayfem/ComfyUI_VLM_nodes


Openpose-ControlNet:

https://huggingface.co/thibaud/controlnet-openpose-sdxl-1.0/resolve/main/control-lora-openposeXL2-rank256.safetensors


InstantID:

https://github.com/cubiq/ComfyUI_InstantID


Fizz:

https://github.com/FizzleDorf/ComfyUI_FizzNodes


BGMusic:

ForeverYoung-Alphaville




Node Diagram
Discussion
w
wang hungwen10 months ago

麥克的視頻中間有糊成一團的狀況,要如何解決?

r
rui40010 months ago

因为帧数过少,补间过渡太急造成的。可以把帧数扩充1倍。目前画了8张,画16张能降低补间出错的问题:)

w
wang hungwen10 months ago

好的,我試試 ,很棒的工作流。

但是使用AI去辨別性別這出發點是很好,不過有些人物會辨別成相反性別,比如野獸前輩(AI判定為female)..

r
rui40010 months ago

嗯,这部分要靠VLM模型的能力,不能做到100%正确。你也可以把性别判定模块改成手动输入Male和Female来实现人工判定:)

李东勇10 months ago

我也发现这里有点不准确, 后来我就把这段去了, 根据图片手动决定是用Female还是Male

k
kaixuan liu6 months ago

I would like to ask how to change the gender determination? Can I directly enter male or female?

k
kaixuan liu6 months ago

I would like to ask how to change the gender determination? Can I directly enter male or female?

星际智念10 months ago

对亚洲人的脸一样适用吗

r
rui40010 months ago

都可以的

雨云10 months ago

我觉得还是偏欧美。但是实验了下亚洲风格的底模,效果也不好

👍1
发条发条10 months ago

求教运行到pose组的图像按边放大时提示“SyntaxError: Unexpected non-whitespace character after JSON at position 4 (line 1 column 5)“”是什么原因?? 把POSE图绕过图像放大nod直接输出到set-pose in也是一样出错

刘星宇10 months ago

为什么一直提示no face detected??


李东勇10 months ago

我也遇到了, 我的场景是我因为某个custom_node是最新版本, 不兼容此workflow, 需要重新手动添加, 手动添加后默认参数和此workflow 不一样, 改成一样的就好了。

我的:Image scale to side 的side_length从1改成1024, 就好了

r
rui40010 months ago

Yes,Image scale to side是Derfuu里面的,它的最新版更改这个节点的名字,导致会加载不出来这个节点,大家用新的同类型节点替换一样就是了。所有修改图片大小的节点都可以。

👏3
a
alex10 months ago

error  https://imgur.com/a/NRHdVOe

K
Kai Zhang10 months ago

#214节点,它收起了,就是楼上说的Image scale to side,     换个相同功能的节点就行了

❤️1
J
Jay10 months ago

运行的时候报错:Error occurred when executing LayerUtility: ImageBlend: images do not match

是要求脸部图片和 Mask 图片尺寸必须一样吗?

J
Jay10 months ago

知道了,image scale to side 的 side_length 需要设置成 1024 (作者提供的 mask 和 logo 的尺寸)

c
carcar ti10 months ago

I encountered this issue while running this workflow, please help me:执行 BatchPromptSchedule 时出错:元组索引超出范围 文件“D:\ComfyUI-aki-v1.1\execution.py”,第 151 行,在 recursive_execute output_data 中,output_ui = get_output_data(obj, input_data_all) 文件“D:\ComfyUI-aki-v1.1\execution.py”,第 81 行,在 get_output_data 中 return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) 文件“D:\ComfyUI-aki-v1.1\execution.py”,第 74 行,在 map_node_over_list 中 results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) 文件“D:\ComfyUI-aki-v1.1\custom_nodes\ComfyUI_FizzNodes\ScheduledNodes.py”, 第 156 行, 在 animate return batch_prompt_schedule(settings, clip) 文件“D:\ComfyUI-aki-v1.1\custom_nodes\ComfyUI_FizzNodes\ScheduleTypes.py”, 第 56 行, 在 batch_prompt_schedule p = BatchPoolAnimConditioning(pos_cur_prompt, pos_nxt_prompt, weight, clip, ) 文件“D:\ComfyUI-aki-v1.1\custom_nodes\ComfyUI_FizzNodes\BatchFuncs.py”, 第 325 行, 在 BatchPoolAnimConditioning interpolated_conditioning = addWeighted([[cond_to, {"pooled_output": pooled_to}]], 文件“D:\ComfyUI-aki-v1.1\custom_nodes\ComfyUI_FizzNodes\ScheduleFuncs.py”,第 90 行,在 addWeighted 中 pooled_output_to = pad_with_zeros(pooled_output_to, max_size) 文件“D:\ComfyUI-aki-v1.1\custom_nodes\ComfyUI_FizzNodes\ScheduleFuncs.py”,第 110 行,在 pad_with_zeros 中 padding = torch.zeros(tensor.shape[0], target_length - current_length, tensor.shape[2]).to(tensor.device)

阿发afa10 months ago

日志报错:Warning: ImageBlend mask mismatch, dropped!

与此同时,生成的视频上半部分是黑色的

y
yonglin lei9 months ago

我也是遇到了,请问解决了吗

y
yonglin lei9 months ago

问题出在加logo那一步,上部分黑色是受到遮罩影响,我没搞定,但是把这一步去掉不影响其它流程

👍1
J
Jamson Liu9 months ago

感谢解答, 也遇到了

许启腾8 months ago

ComfyUI中的PNG和设计软件PS中的PNG感觉是两个概念,导出的图片互不适用。

ComfyUI的PNG和网络上的云端抠图,包括photopea editor 扩展是一个概念,photoshop软件的导出的png 图又是另一个。

我尝试在本地photoshop软件中拉了个渐变,(不经过网络)本地应用到这个节点之后,图片就正常了。

希望有大神可以给出一个理论上的解答。

S
Sunix Liu10 months ago

很奇怪呀,输入了照片,脸始终都换不过来,一直是模型自带的

t
tao king9 months ago

Error occurred when executing ApplyInstantID: 'NoneType' object has no attribute 'copy' File "F:\ComfyUI-aki-v1.3\ComfyUI-aki-v1.3\execution.py", line 151, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) File "F:\ComfyUI-aki-v1.3\ComfyUI-aki-v1.3\execution.py", line 81, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) File "F:\ComfyUI-aki-v1.3\ComfyUI-aki-v1.3\execution.py", line 74, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) File "F:\ComfyUI-aki-v1.3\ComfyUI-aki-v1.3\custom_nodes\ComfyUI_InstantID\InstantID.py", line 383, in apply_instantid c_net = control_net.copy().set_cond_hint(face_kps.movedim(-1,1), cn_strength, (start_at, end_at))

请问下这是什么原因?

还有就是我LLAVA模型都下好了,但就是卡在LLAVA采样器不动,后来我直接不用了,用ollama来获取图片信息了,不知道是否可以

t
tao king9 months ago

在黑头发变成白头发的关键帧转换时容易出现崩坏,不知道是什么原因呢

烛龙zhulong9 months ago

大佬为啥按照你工作流里面的提示词生成,没有小时候的?开始就是成年人,而且看着跟我提供的图片不像

烛龙zhulong9 months ago

亚洲人 不能出小孩面孔,欧洲人可以

烛龙zhulong9 months ago

脸上有时候出现墨镜,有时候鼻子出现白色遮盖  这也没有负向提示词啊


m
majidzendaniyan9 months ago

When loading the graph, the following node types were not found:

👍3
J
Jamson Liu9 months ago

这个问题怎么解啊?

When loading the graph, the following node types were not found:

  • GetNode
  • Image scale to side
  • SetNodeNodes that have failed to load will show as red on the graph.
W
Windmonk8 months ago

Error occurred when executing InstantIDFaceAnalysis: File "F:\Programs\Pinokio\api\comfyui.git\app\execution.py", line 151, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) File "F:\Programs\Pinokio\api\comfyui.git\app\execution.py", line 81, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) File "F:\Programs\Pinokio\api\comfyui.git\app\execution.py", line 74, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) File "F:\Programs\Pinokio\api\comfyui.git\app\custom_nodes\ComfyUI_InstantID\InstantID.py", line 217, in load_insight_face model = FaceAnalysis(name="antelopev2", root=INSIGHTFACE_DIR, providers=[provider + 'ExecutionProvider',]) # alternative to buffalo_l File "F:\Programs\Pinokio\api\comfyui.git\app\env\lib\site-packages\insightface\app\face_analysis.py", line 43, in __init__ assert 'detection' in self.models

How to fix it?

H
HàoÓc8 months ago

please help me with this error! thanks

Error occurred when executing ApplyInstantID: Reference Image: No face detected. File "/content/drive/MyDrive/ComfyUI/execution.py", line 152, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) File "/content/drive/MyDrive/ComfyUI/execution.py", line 82, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) File "/content/drive/MyDrive/ComfyUI/execution.py", line 75, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) File "/content/drive/MyDrive/ComfyUI/custom_nodes/ComfyUI_InstantID/InstantID.py", line 290, in apply_instantid raise Exception('Reference Image: No face detected.')

Y
YUN YUE8 months ago

大佬 这个是什么情况啊 求助中

Cannot execute because a node is missing the class_type property.: Node ID '#367'

R
Rick Zhang7 months ago

Error occurred when executing LayerUtility: ImageBlend: images do not match File "C:\ComfyUI_Cash_Cow_portable\ComfyUI\execution.py", line 316, in execute output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\ComfyUI_Cash_Cow_portable\ComfyUI\execution.py", line 191, in get_output_data return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\ComfyUI_Cash_Cow_portable\ComfyUI\execution.py", line 168, in _map_node_over_list process_inputs(input_dict, i) File "C:\ComfyUI_Cash_Cow_portable\ComfyUI\execution.py", line 157, in process_inputs results.append(getattr(obj, func)(**inputs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\ComfyUI_Cash_Cow_portable\ComfyUI\custom_nodes\ComfyUI_LayerStyle\py\image_blend.py", line 72, in image_blend _canvas.paste(_comp, mask=_mask) File "C:\ComfyUI_Cash_Cow_portable\python_embeded\Lib\site-packages\PIL\Image.py", line 1847, in paste self.im.paste(im, box, mask.im)

一直卡在这里,哪位老师能给指点一下?就是加载遮罩图片mask.png的这个节点。前面的图片生成流程都走完了,到这里就过不去了。


R
Rick Zhang7 months ago

很痛苦,折腾了很久,不知道该怎么办。

# ComfyUI Error Report
## Error Details
- **Node Type:** KSampler (Efficient)
- **Exception Type:** RuntimeError
- **Exception Message:** mat1 and mat2 shapes cannot be multiplied (256x2048 and 768x320)
## Stack Trace

how to solve this problem

E
EDDY20 days ago

2個人的合照可以嗎 例如結婚照

great effort thanks

Author

13
136.7K
2.9K
544.2K

Resources (6)

    All You Life-Photo照片版-Rui.json (36 kB)
    All You Life-Sketch素描版-Rui.json (37.4 kB)
    Pose.png (19.2 kB)
    mask.png (76.9 kB)
    ForeverYoung.MP3.zip (1.4 MB)
    logo.png (20 kB)

Reviews

冯传祥

8 months ago

Z

ZZXYWQ

9 months ago

反推那块儿不好弄但是可以用别的替代,总体来讲是很好的工作流,很值得学习

S

Saurabh Swami

9 months ago

Versions (3)

  • - latest (10 months ago)

  • - v20240531-011606

  • - v20240530-191251

Primitive Nodes (15)

Anything Everywhere (2)

Anything Everywhere3 (1)

Display Any (rgthree) (1)

GetNode (5)

Image scale to side (2)

Note (1)

SetNode (3)

Custom Nodes (45)

ComfyUI

  • - ControlNetLoader (2)

  • - LoadImage (4)

  • - ControlNetApplyAdvanced (1)

  • - EmptyLatentImage (1)

  • - CheckpointLoaderSimple (1)

  • - LoraLoaderModelOnly (2)

  • - PreviewImage (1)

  • - easy compare (1)

  • - InstantIDModelLoader (1)

  • - InstantIDFaceAnalysis (1)

  • - ApplyInstantID (1)

  • - LayerUtility: ImageBlend (2)

  • - ImageGenResolutionFromImage (1)

  • - AIO_Preprocessor (1)

  • - VHS_VideoCombine (1)

  • - VHS_LoadAudio (1)

  • - BatchPromptSchedule (1)

  • - Text _O (4)

  • - Concat Text _O (2)

  • - Replace Text _O (1)

  • - StyleAlignedBatchAlign (1)

  • - LlavaClipLoader (1)

  • - LLava Loader Simple (1)

  • - LLavaSamplerSimple (2)

  • - SimpleText (2)

  • - ViewText (1)

  • - Text Input Switch (1)

  • - Image Filter Adjustments (1)

Checkpoints (1)

SDXL\juggernautXL_v9Rdphoto2Lightning.safetensors

LoRAs (2)

PT滑块\professional专业感.pt

SDXL-Style\PE_PencilDrawing.safetensors