My stuff

  • My Workflows

  • Liked Workflows

  • Following Workflows

Go to OpenArt main site
Upload workflow

By PurzBeats - Flux - Img2Img using Florence2 & CLIP_Interrogator

5.0

0 reviews
21
6.7K
1.7K
3
Description

Source: https://discord.com/channels/851231576494702613/1268987858602168474


Img2Img workflow for Black Forest Labs' new model, Flux. FLUX.1 [pro]: Top-tier performance (API only) FLUX.1 [dev]: Open-weight, efficient, non-commercial use FLUX.1 [schnell]: Fastest for local development and personal use  Download the Models: CLIP: https://huggingface.co/comfyanonymous/flux_text_encoders/tree/main VAE: https://huggingface.co/black-forest-labs/FLUX.1-schnell/blob/main/ae.sft Dev Model Weights: https://huggingface.co/black-forest-labs/FLUX.1-dev Schnell Model Weights: https://huggingface.co/black-forest-labs/FLUX.1-schnell  How to Use in ComfyUI: https://comfyanonymous.github.io/ComfyUI_examples/flux/ Kijai 8fp version: https://huggingface.co/Kijai/flux-fp8/tree/main


  • This workflow is set up for the [dev] variant of the FLUX.1 model.
  • This workflow is HIGH VRAM only, I've only tested it with my 24gb card. Chances are this won't work with less, but you MIGHT be able to do it with 16gb, let me know!
  • We look at an input image, determine a prompt for it, then mix the image in with the prompt and control the level of noise injected into the result to control the 'wildness' of the dream.
  • You can convert this to prompt only by plugging the Empty Latent Image into the Ksampler, instead of the VAE Encode.
  • Same workflow works with Schnell, set your steps to 4. Schnell decreases inference time with the penalty of a less great image, however it uses the same amount of VRAM.


Discussion

(No comments yet)

Loading...

Author

1
1.7K
21
6.7K
    Flux_-_Img2Img.webp (186.8 kB)

No reviews yet

  • - latest (a year ago)

Primitive Nodes (17)

DownloadAndLoadFlorence2Model (1)

FL_ImageNotes (2)

Florence2Run (1)

JWStringConcat (4)

Note (2)

Primitive float [Crystools] (1)

Primitive integer [Crystools] (3)

Primitive string multiline [Crystools] (1)

Reroute (1)

Switch string [Crystools] (1)

Custom Nodes (22)

ComfyUI

  • - KSamplerSelect (1)

  • - UNETLoader (1)

  • - RandomNoise (1)

  • - SamplerCustomAdvanced (1)

  • - PreviewImage (1)

  • - BasicScheduler (1)

  • - BasicGuider (1)

  • - DualCLIPLoader (1)

  • - EmptyLatentImage (1)

  • - VAEEncode (1)

  • - RepeatImageBatch (1)

  • - VAELoader (1)

  • - ImageScale (1)

  • - LoadImage (1)

  • - VAEDecode (1)

  • - CLIPTextEncode (1)

  • - SaveImage (2)

KJNodes for ComfyUI

  • - SomethingToString (1)

  • - ImageConcanate (1)

  • - CLIP_Interrogator (1)

Checkpoints (0)

LoRAs (0)