Canva to SD in real time (LCM, Hyper, Lighting) with LLMs
5.0
0 reviewsDescription
This workflow is for this video tutorial here: https://youtu.be/_t6USD-dX2g
Go watch it for more infos.
Support me on ko-fi: Â https://ko-fi.com/risunobushi
It uses either a LCM, Hyper or Lighting model to create real time generations based on Canva, Photoshop, Illustrator, or whatever really, while the Screen Share node takes care of sourcing the original canvas in a img2img process based on Depth.
It also uses a LLM to automate prompt writing based on what Ollama sees.
Settings for LCM (epicPhotogasm):
- 8 Steps
- CFG 1
- scheduler: sgm_uniform
Settings for Hyper (Juggernaut):
- 6 Steps
- CFG 2
- scheduler: sgm_uniform
Settings for Lighting (Juggernaut):
- 8 Steps
- CFG 1.8
- scheduler: sgm_uniform
Settings for refining stage (epicRealism / Juggernaut v9):
- 20-40 Steps
- CFG 6-8
- scheduler: karras
I strongly suggest Xinsir Depth for XL: https://huggingface.co/xinsir/controlnet-depth-sdxl-1.0
Set your Screen Share node window and area to your canvas, and have fun!
Discussion
(No comments yet)
Loading...
Reviews
No reviews yet
Versions (2)
- latest (a year ago)
- v20240701-115512
Node Details
Primitive Nodes (27)
DepthAnything_V2 (1)
DownloadAndLoadDepthAnythingV2Model (1)
FrequencyCombination (5)
FrequencySeparation (1)
FrequencySeparationHSV (1)
Image Comparer (rgthree) (1)
Note (13)
OllamaImageDescriber (1)
Reroute (3)
Custom Nodes (59)
ComfyUI
- PreviewImage (14)
- VAEDecode (2)
- VAEEncode (3)
- MaskToImage (2)
- CheckpointLoaderSimple (2)
- CLIPTextEncode (3)
- ImageBatch (1)
- KSampler (2)
- ControlNetApply (1)
- ControlNetLoader (1)
- MaskFromRGBCMYBW+ (1)
- PreviewBridge (1)
- ICLightConditioning (1)
- LoadAndApplyICLightUnet (1)
- ColorMatchImage (4)
- BatchAverageImage (1)
- RemapRange (1)
- Int (1)
- ScreenShare (1)
- PreviewPopup (1)
- RemapMaskRange (1)
- RemapImageRange (4)
- GrowMaskWithBlur (1)
- ShowText|pysssss (1)
- SAMModelLoader (segment anything) (1)
- GroundingDinoModelLoader (segment anything) (1)
- GroundingDinoSAMSegment (segment anything) (1)
- JWImageResize (1)
- Image Blend by Mask (1)
- Image Blending Mode (2)
- Text to Conditioning (1)
Model Details
Checkpoints (2)
epicphotogasmLCM_ultimatefidelity.safetensors
epicrealism_naturalSinRC1VAE.safetensors
LoRAs (0)