My stuff

  • My Workflows

  • Liked Workflows

  • Following Workflows

Go to OpenArt main site
Upload workflow

Canva to SD in real time (LCM, Hyper, Lighting) with LLMs

5.0

0 reviews
29
4.7K
1.0K
1
Description

This workflow is for this video tutorial here: https://youtu.be/_t6USD-dX2g

Go watch it for more infos.


Support me on ko-fi:  https://ko-fi.com/risunobushi

It uses either a LCM, Hyper or Lighting model to create real time generations based on Canva, Photoshop, Illustrator, or whatever really, while the Screen Share node takes care of sourcing the original canvas in a img2img process based on Depth.


It also uses a LLM to automate prompt writing based on what Ollama sees.


Settings for LCM (epicPhotogasm):

- 8 Steps

- CFG 1

- scheduler: sgm_uniform


Settings for Hyper (Juggernaut):

- 6 Steps

- CFG 2

- scheduler: sgm_uniform


Settings for Lighting (Juggernaut):

- 8 Steps

- CFG 1.8

- scheduler: sgm_uniform


Settings for refining stage (epicRealism / Juggernaut v9):

- 20-40 Steps

- CFG 6-8

- scheduler: karras


I strongly suggest Xinsir Depth for XL: https://huggingface.co/xinsir/controlnet-depth-sdxl-1.0


Set your Screen Share node window and area to your canvas, and have fun!

Discussion

(No comments yet)

Loading...

Author

33
153.6K
2.2K
500.5K

No reviews yet

  • - latest (a year ago)

  • - v20240701-115512

Primitive Nodes (27)

DepthAnything_V2 (1)

DownloadAndLoadDepthAnythingV2Model (1)

FrequencyCombination (5)

FrequencySeparation (1)

FrequencySeparationHSV (1)

Image Comparer (rgthree) (1)

Note (13)

OllamaImageDescriber (1)

Reroute (3)

Custom Nodes (59)

ComfyUI

  • - PreviewImage (14)

  • - VAEDecode (2)

  • - VAEEncode (3)

  • - MaskToImage (2)

  • - CheckpointLoaderSimple (2)

  • - CLIPTextEncode (3)

  • - ImageBatch (1)

  • - KSampler (2)

  • - ControlNetApply (1)

  • - ControlNetLoader (1)

ComfyUI Essentials

  • - MaskFromRGBCMYBW+ (1)

  • - PreviewBridge (1)

  • - ICLightConditioning (1)

  • - LoadAndApplyICLightUnet (1)

  • - ColorMatchImage (4)

  • - BatchAverageImage (1)

  • - RemapRange (1)

  • - Int (1)

  • - ScreenShare (1)

  • - PreviewPopup (1)

  • - RemapMaskRange (1)

  • - RemapImageRange (4)

  • - GrowMaskWithBlur (1)

  • - SAMModelLoader (segment anything) (1)

  • - GroundingDinoModelLoader (segment anything) (1)

  • - GroundingDinoSAMSegment (segment anything) (1)

  • - Image Blend by Mask (1)

  • - Image Blending Mode (2)

  • - Text to Conditioning (1)

Checkpoints (2)

epicphotogasmLCM_ultimatefidelity.safetensors

epicrealism_naturalSinRC1VAE.safetensors

LoRAs (0)