Outpainting with ControlNet in Stable Diffusion Webui

Outpainting is a process to expand an existing image to a bigger size and fill the space with graphic elements not in the original image. It can be done with the help of ControlNet.

1. If you don’t have Stable Diffusion Webui installed, go to Install stable diffusion webui on Windows.
2. If you haven’t installed ControlNet, go to Install ControlNet in Stable Diffusion Webui.
3. Go to ControlNet -v1-1 to download “control_v11p_sd15_inpaint.pth” and put it in the directory “extensions\sd-webui-controlnet\models.”
4. Run “webui-user.bat” to open Stable Diffusion webui in a browser at http://127.0.0.1:7860/.
5. Select a checkpoint. In txt2img tab, enter your prompt to describe the image you want. Set Batch count to be 4.
6. In ControlNet section, drag your image in. Check “Enable” underneath.
7. Select Control Type to “Inpaint”. This will change Preprocessor to “inpaint_only” and Model to “control_v11p_sd15_inpaint”.
8. (Important) Find the width and height of the original image. Increase either Width or Height (not both) at a time. In ControlNet area, check Resize Mode to “resize and fill”.
9. Click Generation button.
10. After images are generated, drag a good output image to your ControlNet as a new baseline to continue. Increase Width or Height and click Generate button.
11. Repeat the process until you have your ideal image.