Weather Flex Converter
5.0
0 reviewsDescription
What does it do?
This workflow was designed for the "Weather Changing" challenge.
It involves uploading an image and describing the desired situation in the dedicated box.
For example, typing "Heavy snow" will result in an image depicting heavy snowfall, while typing "lightning storm" will display a powerful thunderstorm.
Similarly, entering "sandstorm" will transform the image into a location filled with sand both on the ground and in the air.
A unique feature of this workflow is its flexibility: in addition to the predefined weather options required by the challenge, you can input any word to modify the image's situation.
For instance, typing "flood" will portray the location in the photo as flooded, adding a dramatic and realistic element to the scene.
How does he do it?
This process is made possible by using the "instruct pix2pix" checkpoint.
To make this checkpoint work on Comfyui, a method combining Controlnet and the new Ipadapter was necessary.
The checkpoint is activated through positive requests, specifying the desired change.
For example, you can request to change the hair color of a person or add scenic elements to the photo.
Additionally, I've used LLM to describe the scene and create the prompt needed to generate a high-resolution image, also leveraging Ultimate SD Upscale to highlight details.
Research and Information
For further insights into using "instruct pix2pix," you can search for information on YouTube or Google.
Or go directly to Stable Diffusion's official website at this address:
https://stable-diffusion-art.com/instruct-pix2pix/
the model I used is the older model, but doing a search afterwards I found a newer model, which you can find at CivitAI
I tested the most updated model, found on CivitAI, it is lighter, only 2Gb compared to the 7Gb of the old model, I put here some images generated with this model.
The word "Ligthning Storm" was used.
The word "flood" was used.
In conclusion, this workflow offers a fun and flexible way to modify images according to personal preferences, including simulating natural phenomena such as floods.
below some extra challenge images
generated with old model
The word "Flood" was used.
The word "Autumnal" was used.
The word "Christmas" was used.
Node Diagram
Discussion
installing nodes over manager gibes error ntdviet/comfyui-ext update failed: Bad Request
but did it give you the error when you were installing the custom nodes? if so i'm sorry, but this should be an error in the comfyui manager, not in my workflow, i wouldn't know how to help you.
嗨!
我是 BoredWhy 的 Marcio。
您的这个工作流程真是太棒了!我们已将其在 BoredWhy 上线,方便大家体验和使用。希望您不介意!
请点击这里查看:https://boredwhy.com/workflow/6835ac1006e3ecb3f839bb41
当然,所有的功劳都归您所有!
-----------------
Hey there! Marcio from BoredWhy here.
Super cool workflow! We've put it online for people to easily try out on BoredWhy – hope you don't mind!
Check it out here: https://boredwhy.com/workflow/6835ac1006e3ecb3f839bb41
And of course, full credit goes to you!
Node Details
Primitive Nodes (10)
Image Comparer (rgthree) (1)
Image scale to side (1)
Note (1)
Note Plus (mtb) (1)
Simple String (6)
Custom Nodes (99)
- CR Text Concatenate (2)
ComfyUI
- CLIPTextEncode (4)
- CheckpointLoaderSimple (2)
- VAEEncode (1)
- ControlNetLoader (3)
- ControlNetApply (3)
- Canny (1)
- VAEDecode (2)
- KSampler (2)
- LoadImage (1)
- PreviewImage (1)
- UpscaleModelLoader (1)
- LatentUpscaleBy (1)
- IPAdapterNoise (1)
- IPAdapterUnifiedLoader (1)
- IPAdapterAdvanced (1)
- mape Variable (53)
- Save Image If True (1)
ntdviet/comfyui-ext
- gcLatentTunnel (1)
- ShowText|pysssss (6)
- UltimateSDUpscale (1)
- LLavaSamplerSimple (3)
- LlavaClipLoader (1)
- LLava Loader Simple (1)
- Text Concatenate (4)
- Text Multiline (1)
Model Details
Checkpoints (2)
epicrealism_pureEvolutionV5.safetensors
instruct-pix2pix-00-22000.safetensors
LoRAs (0)