What are the use cases of video to video?
You can add styles to your videos, turn video footages to animations, change characters in videos.
How to run video to video in ComfyUI?
1. If you haven’t installed ComfyUI, go to Install ComfyUI on Windows.
2. If you haven’t installed IPAdapter for ComfyUI, go to install IPAdapter in ComfyUI.
3. If you haven’t installed AnimateDiff for ComfyUI, go to install AnimateDiff-Evolved in ComfyUI.
4. If you haven’t installed ControlNet for ComfyUI, go to install ControlNet in ComfyUI.
5. Run “run_nvidia_gpu.bat” or “run_cpu.bat” to open ComfyUI in a browser at http://127.0.0.1:8188/.
6.
Download comfyui_vid2vid.json
This is the script to run the workflow. Drag the json file to your ComfyUI in the browser.
7. In the Load Checkpoint node, select a checkpoint which co/downloads/#vid2vidmpatible with sd1.5 in your “ComfyUI\models\checkpoints” directory.
8. In the Load LoRA nodes, select Lora models you have in “ComfyUI\models\loras” directory.
9. In the Load Video node, upload your video with character(s) moving. The character(s) should be clear on the screen. Write a prompt to describe the movement.
10. In the Load Image node (inside IPAdapter group), select a picture of the character you want to replace the character in the video.
11. Click Queue Prompt button to run the workflow. Monitor the progress in the ComfyUI console.
12. When it finishes, the output videos are showing at Video Combine nodes.