Txt2Img PixArt with SDXL Refiners & SUPIR
5.0
0 reviewsDescription
Update - Removed the Garbage Collector nodes following advice in the comments. Also added a Face Detailer after the second refiner step, a Save node in case you want to do post detailing work without it being upcaled and a Preview Selector node to choose which (if any), images to pass to SUPIR.
--------------------------------------------------------------------------------------------------------------
This workflow was the base that I built upon - https://civitai.com/articles/5355/installing-comfyui-for-use-with-pixart-sigma Instructions for installing and getting PixArt set up properly can be found on that article.
I'm using the PixArt-Sigma-XL-2-1024-MS checkpoint model from here: https://huggingface.co/PixArt-alpha/PixArt-Sigma/tree/main
For T5, create a T5 folder in models and get models.safetensors and config.json from here and put them in that folder: https://huggingface.co/city96/t5-v1_1-xxl-encoder-bf16/tree/main
Get the VAE here: https://huggingface.co/PixArt-alpha/PixArt-alpha/tree/main/sd-vae-ft-ema
The workflow worked nicely but wanted to see if I could improve it by adding SDXL refiners and an upscaler.
It starts with the Pixart generation (note: I have the T5v1.1 Loader node set to GPU, if you have a lower VRAM card change this to CPU). It then goes to a SDXL settings group where you can set the checkpoint model and LoRAs. If you do not want to use a Hyper 8 step LoRA, increase the steps in the refiner Ksamplers.
It gets a small 1.1 latent upscale and is then passed through a step refine and then onto SUPIR for Upscaling. I have the SUPIR set to HighVRAM, drop this unless you have enough VRAM.
Really happy with the results I'm getting on this.
Discussion
(No comments yet)
Loading...
Reviews
No reviews yet
Versions (2)
- latest (a year ago)
- v20240623-233736
Node Details
Primitive Nodes (16)
Fooocus_KSamplerEfficient (2)
GetNode (6)
Image Comparer (rgthree) (1)
Lora Loader Stack (rgthree) (2)
PrimitiveNode (2)
SetNode (3)
Custom Nodes (45)
- CR Simple Text Watermark (1)
- CR Apply LoRA Stack (1)
- CR LoRA Stack (1)
ComfyUI
- UpscaleModelLoader (1)
- LatentUpscaleBy (1)
- KarrasScheduler (1)
- SaveImage (3)
- VAEDecode (1)
- VAEEncode (1)
- PreviewImage (3)
- ImageUpscaleWithModel (1)
- CLIPTextEncode (3)
- EmptyLatentImage (1)
- CheckpointLoaderSimple (1)
- ImageScaleBy (1)
- SamplerDPMPP_3M_SDE_DynETA (1)
- SamplerCustomNoise (1)
- HfImageToRGB (1)
- UltralyticsDetectorProvider (1)
- SAMLoader (1)
- FaceDetailer (1)
- Automatic CFG (1)
- SUPIR_model_loader_v2 (1)
- SUPIR_first_stage (1)
- SUPIR_conditioner (1)
- SUPIR_sample (1)
- SUPIR_decode (1)
- SUPIR_encode (1)
- T5v11Loader (1)
- PixArtResolutionSelect (1)
- ExtraVAELoader (1)
- T5TextEncode (2)
- PixArtCheckpointLoader (1)
- Preview Chooser (1)
- ColorMatch (1)
- LoraInfo (1)
- PlaySound|pysssss (1)
- Output min/max sigmas (1)
Model Details
Checkpoints (2)
01. SDXL\Blasted_RacketXL_V1.0.safetensors
08. PixArt\PixArt-XL-2-1024-MS.pth
LoRAs (7)
01. SDXL\Cinematic Hollywood Film.safetensors
01. SDXL\Hyper-SDXL-8steps-lora.safetensors
01. SDXL\faces_v3.safetensors
01. SDXL\lora-sdxl-perfect-eyes.safetensors
01. SDXL\photorealistic_portrait_notrigger.safetensors