IPAdapter Kolors vs Plus
5.0
1 reviews
Description
A simple workflow for either using the new IPAdapter Plus Kolors or comparing it to the standard IPAdapter Plus by Matteo (cubiq).
Video tutorial here: https://www.youtube.com/watch?v=K6QtcdSD1r4&lc=UgzUBT_wLng9_-WuGS14AaABAg
Want to support me? Buy me a ko-fi here: https://ko-fi.com/risunobushi
Install missing custom nodes via the manager, or from the GitHub via git clone: https://github.com/MinusZoneAI/ComfyUI-Kolors-MZ
Kolors (checkpoint, place it in the models/UNET folder): https://huggingface.co/Kwai-Kolors/Kolors/resolve/main/unet/diffusion_pytorch_model.fp16.safetensors
Kolors (huggingface page): https://huggingface.co/Kwai-Kolors/Kolors
ChatGLM3 (model, place it in the models/LLM folder): https://huggingface.co/Kijai/ChatGLM3-safetensors/resolve/main/chatglm3-fp16.safetensors
IPAdapter Plus Kolors (model, place it in the models/ipadapter folder): https://huggingface.co/Kwai-Kolors/Kolors-IP-Adapter-Plus/resolve/main/ip_adapter_plus_general.bin
CLIPVision Kolors (model, place it in the models/clip_vision folder): https://huggingface.co/Kwai-Kolors/Kolors-IP-Adapter-Plus/resolve/main/image_encoder/pytorch_model.bin
Node Diagram
Discussion
Getting this error; !!! Exception during processing!!! Error(s) in loading state_dict for CLIPVisionModelProjection:
size mismatch for vision_model.embeddings.position_embedding.weight: copying a param with shape torch.Size([577, 1024]) from checkpoint, the shape in current model is torch.Size([257, 1024]).
MZ_KolorsCLIPVisionLoader
Very clear answer!
It's already installed but same error
hi! you installed the fp32 version of kolors instead of the fp16 version
I downloaded all files as given above. I mean which proveded in the description
(Edited)I had another user on youtube who had the same error as you, please check if your unet checkpoint says fp16 or fp32
Node Details
Primitive Nodes (11)
LoadChatGLM3 (1)
MZ_ChatGLM3 (2)
MZ_IPAdapterAdvancedKolors (1)
MZ_KolorsUNETLoader (1)
Note (6)
Custom Nodes (17)
ComfyUI
- VAELoader (1)
- CLIPVisionLoader (1)
- EmptyLatentImage (2)
- CheckpointLoaderSimple (1)
- KSampler (2)
- VAEDecode (2)
- PreviewImage (2)
- LoadImage (1)
- CLIPTextEncode (2)
- IPAdapterModelLoader (1)
- IPAdapterUnifiedLoader (1)
- IPAdapterAdvanced (1)
Model Details
Checkpoints (1)
juggernautXL_v9Rundiffusionphoto2.safetensors
LoRAs (0)