How to run Text to Video using AnimateDiff?
1. If you haven’t installed AnimateDiff, go to install AnimateDiff from github.
2. Under “AnimatedDiff” directory, go to “configs\prompts\v1”. There are 8 sample yaml files in which different checkpoints are used, such as ToonYou, RealisticVision etc. Select one yaml file and edit it.
3. In the field of dreambooth_path, compare the name of checkpoint with the name of checkpoint in “models\DreamBooth_LoRA.” If they have different version numbers, update in the script to match with the name in the directory.
4. In the field of motion_module, make sure you have downloaded the motion module “mm_sd_v15.ckpt”, and put it in “models\Motion_Module” directory.
5. The default width and height of the output video is 512×512. If you want to render faster, you can set the width and height smaller. Add this in the script
W: 256
H: 256
6. Change the prompt. You can run one prompt instead of four at a time by removing three prompts. Save the yaml file.
7. Open an Anaconda Prompt. Run command:
>conda activate animatediff
8. In the Anaconda prompt, go to the directory “AnimateDiff” and run one of your yaml file, for example:
>python -m scripts.animate –config configs/prompts/v1/v1-1-ToonYou.yaml
9. Monitor the progress in the Anaconda console. When it finishes, the result can be found in the “samples” directory.
10. Modify your prompts and run again until you find good results.