Preface

The workflow shows how Controlnet can be used for inpainting.  The workflow is for testing and learning purposes. Each step is documented by a preview of an image.

Prerequisites

One needs a SD model. Each SD model can be used in principle. For the ControlNet one needs a working ControlNet model.

What the Workflow Does

The workflow can be used to exchange parts of an image by other content.

How to Use the Workflow

Load an image for inpainting using the Load Image node. Then right click on the mouse  in the node and select  Open in MaskEditor. The image is then opened in a window wide editor window. Now a mask can be painted by a brush. The content of the painted mask will be exchanged.

Special Feature

I installed a node which allows the visualisation of latent images. On can check how to latent images are developed  until the VAE decoder creates an image from them.

References

[1]  https://huggingface.co/lllyasviel/ControlNet-v1-1/blob/main/control_v11p_sd15_inpaint.pth

[2]  https://github.com/martijnat/comfyui-previewlatent