My stuff

  • My Workflows

  • Liked Workflows

  • Following Workflows

Go to OpenArt main site
Upload workflow

[v3.0] BG Changer v2

5.0

0 reviews
35
8.4K
2.0K
2
Description

1) First Time Video Tutorial :  https://www.youtube.com/watch?v=qczh3caLZ8o&ab_channel=JerryDavosAI

.

2) Free Breakdown Tutorial: https://www.patreon.com/posts/v3-0-bg-changer-97728634

.

.

- Render Video 1 - Collide - https://youtube.com/shorts/Xayw0JYn6yI

- Render Video 2 -  Bad Devil - YT : https://youtube.com/shorts/wzfYILSeTMA

.


HOW TO USE:

Important : You need 2 Controlnet Passes From here first :  https://www.patreon.com/posts/v3-0-raw-masking-96587664

And Automask from here :  https://www.patreon.com/posts/update-v3-0-96482739


1) Choose Model checkpoint you want to use

2) Enter Width and Height of your Output Image

3) Choose Positive Prompts, you want to see in the output

4) Choose Loras, (You have to experiment which looks good or not)

5) Paste the Passes Directories in ControlNets (1 and 2) Loaders and set their models and weight (See Neon Purple note)

Enter Single or Sequence Background here:


6) Paste The Directory where you want to save the Images in the Output Save Directory Node

7) Select Batch Range (Number of images you want to render in one Queue)

8) Choose LCM, Highres and AD Motion Settings, Default is good but experimental (See note)

9) After every batch you can increase the batch naming for organizing the batches.

10) After every queue increase the skip frames to the Total number of images rendered already.

11) After All the batches are rendered it's Ready for #3 LCM Refiner workflow


*Don't Use Overlapping Technique in this phase, Use that in the final refiner phase,


________________________________________

Breakdown :


A New File  - 2_6) BG_Changer v2 has been added in the GDrive folder :

https://drive.google.com/drive/folders/1HoZxKUX7WAg7ObqP00R4oIv48sXCEryQ

.
Now you can have consistent custom Single Background or Sequence background.

Better backgrounds which are close to inputted image.  

Prerequisites

1) If you are new to this workflow, Watch these Video and tutorial first to get how things work:

  • https://youtu.be/qczh3caLZ8o
  • https://www.patreon.com/posts/update-v2-1-lcm-95056616
  • 2) Controlnet - SoftedgePlus and AutoMask from this workflow:  https://www.patreon.com/posts/update-v3-0-lcm-96482739


    .

    Breakdown 1 [ Single Background ]

    Render Video Link : https://youtube.com/shorts/Xayw0JYn6yI


    Controlnets Preview:

    For the Single Background:

    Controlnets weights -
    1) SoftedgePlus [ 0.9 , 0 , 0.85 ]
    2) OpenPose [ 0.8, 0 , 0.8 ]



    Mask


    Softedge and Auto Mask generated from file 1_1) Controlnet_Automasking_SoftedgePlus : https://www.patreon.com/posts/update-v3-0-lcm-96482739

    .


    Since It is not LCM Settings are updated to the following in the workflow file.



    .


    1) Umute the Single Group and Connect it the Image Adjustment node to use it (See the Above Picture For Reference

    2) Upload a single image into the Background Single Node


    One By one, the above backgrounds were uploaded to the background node and rendered.


    CON

    Flickering is observed in the renders of Single Background.... will try to fix this.


    It's due to injection of Background latents in the middle of the render process, so it acts like img2img renders and flickers.  
    It can be reduced by decreasing the value in "Start Highres Fix from nth Step" node ) but the original background will be lost.  

    ---------------------------------------------------------------------------------------------------------


    Breakdown 2 - [ Sequence Background ]

    Render Video : https://youtube.com/shorts/wzfYILSeTMA


    All Controlnets Settings, Mask , and other were same like the Single Background one.

    .


    Background



    The Fire Video was brought into after Effects, cropped and Rendered out as Image Sequence, and then the folder path was used as the Input in the background node.

    Like this:


    .

    Unmute Background Sequence Group and Make the connection to Image Adjustment node

    .

    For Part 1 normal "Yellow" was used for Fire and In Part 2 - It was color hue shifted to blue with the above adjustment to look like a Blue fire which will after render will looks like "Abstract water fire"

    Multiple Loras and It's weights were tested and the 4th one has the most "water fire"  with similar fire physics and motion, So went with it.

    Face Fix Reactor


    1) Images were refined

    2) Then face fixed with v2.1 Face Fix file then

    3) Face swapped with scarlett johansson using the old "5) Batch Face Swap - ReActor [Experimental] workflow"  with the following settings:



    Then All frames were composed in After Effects


    ___________________________________________________________________



    Models and Lora List



    niMerge Model was used for making the above renders: https://civitai.com/models/144249?modelVersionId=250801



    Lora List :


  • Pyromancer : https://civitai.com/models/131189/pyromancer
  • Fire - https://civitai.com/models/9049/firevfx-create-more-consistent-fire
  • Fire 2 - https://civitai.com/models/78246/v2
  • Liquid Cloths - https://civitai.com/models/71745/conceptliquid-clothesliquid-dress
  • Underwater - https://civitai.com/models/143452/underwater-concept
  • WaterVFX - https://civitai.com/models/10750/watervfx-create-more-consistent-water-wip
  • Water VFX v3 - https://civitai.com/models/83586/v3
  • Submerged Water - https://civitai.com/models/19206/submergedwater
  • Bubbles - https://civitai.com/models/111400/soap-bubble-background-lora
  • Chamaleon Dress - https://civitai.com/models/137557/phantasmal-luminous-the-radiance-of-rainbow-dispersion
  • Intricate Dress - https://civitai.com/models/134315
  • Snow_sora : https://civitai.com/models/121784/snowflakes-and-snow-or-concept-magic
  • ElectrcityLight - https://civitai.com/models/159012/lightning
  • Xsarchitecture - https://civitai.com/models/27530/xsarchitectural-21futuretechnologycity


  • Some of the Loras are renamed in my PC, please find it in the above list or search for similar Loras on Civitai.




    _________________________________________________________________________

    Downloads Raw

    Prompts and Settings Folder Has the All Raw Files of the workflows mentioned above to study. Drag and Drop into Comfyui workspace to use them.



    Prompts and Settings Folder : https://drive.google.com/drive/folders/1nCOjN1qETfRiQGmQhiyM7f3TUTTlulPA?q=parent:1nCOjN1qETfRiQGmQhiyM7f3TUTTlulPA


    The workflows above in the photos embeds might be different from the Main Uploaded 2_6) Bg Changer   workflow as they were prototypes workflows for testing out. Use main 2_6) workflow to get the Best results.




    ___________________________________________________________________

    If you need Cloud GPU : https://www.runcomfy.com/?ref=jerrydavos

    My Discord Server : https://discord.gg/z9rgJyfPWJ


    Discussion

    (No comments yet)

    Loading...

    Author

    30
    169.9K
    3.3K
    2.7M

    No reviews yet

    • - latest (2 years ago)

    Primitive Nodes (89)

    GetNode (29)

    Note (17)

    PrimitiveNode (3)

    Reroute (25)

    SetNode (15)

    Custom Nodes (89)

    Allor Plugin

    • - ImageEffectsAdjustment (1)

    • - CheckpointLoaderSimpleWithNoiseSelect (1)

    • - ADE_AnimateDiffLoaderWithContext (1)

    • - ADE_AnimateDiffUniformContextOptions (1)

    • - ADE_AnimateDiffModelSettingsSimple (1)

    • - CR Integer To String (1)

    • - CR Apply LoRA Stack (1)

    • - CR LoRA Stack (2)

    ComfyUI

    • - PreviewImage (6)

    • - FreeU_V2 (1)

    • - ImageToMask (1)

    • - InvertMask (1)

    • - VAELoader (1)

    • - CLIPSetLastLayer (1)

    • - LatentUpscaleBy (1)

    • - LoadImage (1)

    • - ImageScale (2)

    • - VAEDecode (1)

    • - VAEEncode (1)

    • - LatentUpscale (1)

    • - LatentCompositeMasked (1)

    • - KSamplerAdvanced (2)

    • - ImpactSwitch (2)

    • - LineArtPreprocessor (1)

    • - BNK_InjectNoise (1)

    • - TonemapNoiseWithRescaleCFG (1)

    • - ControlNetLoaderAdvanced (3)

    • - ACN_AdvancedControlNetApply (3)

    • - LoadImagesFromDirectory (4)

    • - Int (2)

    • - VHS_SplitImages (6)

    • - BatchPromptSchedule (1)

    • - FloatConstant (9)

    • - ImageBatchRepeatInterleaving (1)

    • - MathExpression|pysssss (2)

    • - Int Literal (7)

    • - Cfg Literal (3)

    • - LatentGaussianNoise (1)

    • - smZ CLIPTextEncode (2)

    • - Image Save (1)

    • - Text String (1)

    • - Text Concatenate (1)

    • - Text Multiline (3)

    • - Logic Boolean (2)

    • - Image Blank (1)

    • - String to Text (1)

    Checkpoints (1)

    animerge_v23.safetensors

    LoRAs (0)