What is a backdrop of a stage show or an animation?
Backdrop refers to a large photographic backing or painting for the background of a scene. In an animation, it is a layer of background image indicating the location or environment of the scene.
How to create backdrops with Depth ControlNet in Stable Diffusion Webui?
1. If you don’t have stable diffusion Webui installed, go to Install stable diffusion webui on Windows.
2. If you haven’t installed ControlNet, go to install ControlNet in Stable Diffusion Webui.
3. Go to ControlNet -v1-1 to download “control_v11f1p_sd15_depth.pth” and put it in the directory “extensions\sd-webui-controlnet\models.”
4. On internet, search for an image that has similar depth to the image you want to generate.
5. Run “stable-diffusion-webui/webui-user.bat” to open Stable Diffusion Webui in a browser at http://127.0.0.1:7860/.
6. Select a Stable Diffusion checkpoint in the drop down.
7. In txt2img tab, enter your prompt to describe your image. Set the Width and Height around 768 ~1024 if you are using a sdxl checkpoint. Set the image ratio the same an the input image. Other settings can be default.
8. Expand ControlNet section. Drag your drawing to the first Single Image. Check “Enable”.
9. In ControlType, select “Depth.” The Preprocessor will fill with “depth_midas”, In the Model dropdown, select “control_v11f1p_sd15_depth.”
10. Click Generate button.