How to turn image to video using AnimateDiff in ComfyUI?
1. If you haven’t installed ComfyUI, go to Install ComfyUI on Windows.
2. If you haven’t installed IPAdapter for ComfyUI, go to install IPAdapter in ComfyUI.
3. If you haven’t installed AnimateDiff for ComfyUI, go to install AnimateDiff-Evolved in ComfyUI.
4. Go to huggingface AnimateLCM to download “AnimateLCM_sd15_t2v.ckpt” and put it at “ComfyUI\custom_nodes\ComfyUI-AnimateDiff-Evolved\models.” Also download “AnimateLCM_sd15_t2v_lora.safetensors” and put at “ComfyUI\models\loras.”
5. Go to huggingface animatediff to download motion modules such as “v3_sd15_dapater.ckpt” and put it at “ComfyUI\models\loras.”
6. Run “run_nvidia_gpu.bat” or “run_cpu.bat” to open ComfyUI in a browser at http://127.0.0.1:8188/.
7.
Download comfyui_animatelcm.json
This is the the script to run the workflow. Drag the json file to your ComfyUI in the browser.
8. In the Load Checkpoint node, select a checkpoint which compatible with sd1.5 in your “ComfyUI\models\checkpoints” directory.
9. In the Load Image node, upload a photo with trees, lakes or ocean, fire, woman’s long hair. Write a prompt to describe the image.
10. Click Queue Prompt button to run the workflow. Monitor the progress in the ComfyUI console.
11. When it finishes, the output videos are showing at Video Combine nodes.