Go to OpenArt main site
Upload workflow

FLUX + Hyper Lora 8 Steps + LLM + Detailing + Inpainting + Upscaling + Low Vram

4.5

2 reviews
31
11.9K
2.5K
2
Description


Made with Hyper Flux 8steps and Flux Dev Q4_0.GGUF. The main goal is to use FLUX with 8GB VRAM (my own configuration).

Multiple functions in the workflow are controlled by a switch in Group 0 (the black one).


1- Inpainting: it offers three options: (SAM Detector + Custom Mask or Only Custom Mask or Mask Uploaded)


2- Prompt Generation: A prompt can be generated either through text or an image via a LLM.


3- 1st Detailing: it is performed with FLUX.


4- Upscaling: it is done using the Tile Diffusion Node, SDXL Lightning, and CN SDXL Tile. It operates quickly and produces stunning results.


5- 2nd Detailing: a second pass is done with SDXL/FLUX for the background and the main subject.


6- Post-Processing: a final step of post-processing is done to adjust brightness, contrast, etc.


Make sure to download the exact models shown in the workflow. I selected them specifically to work with my 8GB VRAM card.

Models:

- flux1-dev-Q4_0.gguf

- Hyper-FLUX.1-dev-8steps-lora.safetensors

- t5xxl_fp8_e4m3fn.safetensors

- 4xLeexicaDat2_otf.pth

- 4x-UltraSharp.pth

- 4xFaceUpDAT.pth

- dreamshaperXL_lightningDPMSDE.safetensors

- ttplanetSDXLControlnet_v20Fp16.safetensors


Please, note the package required for Ollama is ComfyUI Ollama by stavsap.

ComfyUi-Ollama-YN is not required and create conflict with the Ollama nodes.



Discussion

(No comments yet)

Loading...

Author

3
8.1K
76
32.1K

No reviews yet

  • - latest (25 days ago)

  • - v20240906-192820

  • - v20240906-143347

  • - v20240906-143311

  • - v20240906-133947

  • - v20240905-182824

  • - v20240905-182316

  • - v20240905-151019

  • - v20240903-003347

Primitive Nodes (131)

Any Switch (rgthree) (33)

BooleanBasic (2)

DF_Get_image_size (1)

Display Int (rgthree) (2)

DownloadAndLoadFlorence2Model (1)

DownloadAndLoadSAM2Model (1)

EmptySD3LatentImage (1)

Fast Groups Muter (rgthree) (1)

Florence2Run (1)

Florence2toCoordinates (1)

FluxGuidance (3)

FluxSampler (2)

GetNode (21)

Image Comparer (rgthree) (6)

LayerColor: AutoAdjustV2 (1)

ModelSamplingFlux (2)

Note (15)

PrimitiveNode (4)

Sam2Segmentation (1)

Seed (rgthree) (6)

SetNode (14)

UnetLoaderGGUF (2)

workflow/Checkpoint (2)

workflow/Detailer_Settings (1)

workflow/Settings (1)

workflow/Simple_Background (1)

workflow/Simple_Object (1)

workflow/Tiles_Background (1)

workflow/Tiles_Object (1)

workflow/cn_background-strength (1)

workflow/cn_subject_strength (1)

Custom Nodes (115)

Comfyroll Studio

  • - CR Text (1)

ComfyUI

  • - InpaintModelConditioning (1)

  • - ImageUpscaleWithModel (2)

  • - ConditioningZeroOut (1)

  • - BasicGuider (1)

  • - PreviewImage (5)

  • - LoadImageMask (1)

  • - SamplerCustomAdvanced (1)

  • - BasicScheduler (1)

  • - KSamplerSelect (1)

  • - VAEDecode (2)

  • - InvertMask (1)

  • - LoraLoaderModelOnly (2)

  • - UpscaleModelLoader (2)

  • - DualCLIPLoader (2)

  • - CLIPTextEncode (7)

  • - VAELoader (2)

  • - RandomNoise (1)

  • - SaveImage (6)

  • - GrowMask (1)

  • - LoadImage (2)

  • - ImageScaleBy (3)

  • - DifferentialDiffusion (1)

  • - CheckpointLoaderSimple (1)

  • - VAEDecodeTiled (1)

  • - VAEEncodeTiled (1)

  • - ImageScale (1)

  • - ControlNetApplyAdvanced (1)

  • - ImageBlend (2)

  • - MaskPreview+ (1)

  • - GetImageSize+ (1)

  • - AddMask (1)

  • - PreviewBridge (1)

  • - ImpactSwitch (2)

  • - ImpactControlBridge (12)

  • - ImpactGaussianBlurMask (1)

  • - ImpactSchedulerAdapter (2)

  • - SEGSPreview (4)

  • - DetailerForEach (2)

  • - KSampler //Inspire (1)

  • - LayerColor: Levels (1)

  • - LayerUtility: PurgeVRAM (6)

  • - OllamaVision (1)

  • - OllamaGenerateAdvance (3)

  • - ControlNetLoaderAdvanced (1)

  • - TTPlanet_TileSimple_Preprocessor (1)

  • - ImageAndMaskPreview (1)

  • - ColorMatch (3)

  • - ShowText|pysssss (4)

  • - MathExpression|pysssss (5)

  • - Checkpoint Selector (2)

  • - VAEDecodeTiled_TiledDiffusion (1)

  • - VAEEncodeTiled_TiledDiffusion (1)

  • - TiledDiffusion (1)

  • - Image Blending Mode (2)

Checkpoints (5)

realvisxlV50_v50LightningBakedvae.safetensors

LoRAs (2)

HyperSD\FLUX.1\Hyper-FLUX.1-dev-8steps-lora.safetensors