Realtime Diffusion / Deforum Animations in TouchDesigner! (text-to-video)

This is a quick video showing my (hack-y) method for getting realtime diffusion / deforum animations into TouchDesigner!

Intro: 00:00
Walkthrough: 01:07
Tutorial: 03:05
Expression Switcher: 05:03
File Selector and Movie Output: 08:17
WebUI Settings: 11:44
Prompts: 14:04
Final Setings: 15:05
Generate!: 16:06
Tweaks: 17:10
Outro: 17:21

You can set it up to make amazing text-to-video animations, then projection-map them, use them for Geo Instancing, or even pipe them through Syphon to UE5 ; )

Huge, huge thanks to all the people at Stable Diffusion, Automatic1111, and the Deforum team for creating these amazing creative technologies. I can’t wait to see what the future holds for all this AI stuff!

Links:

automatic1111 webui: https://github.com/AUTOMATIC1111/stable-diffusion-webui

automatic1111 deforum extension: https://github.com/deforum-art/deforum-for-automatic1111-webui

Thanks for watching! Like and subscribe and send me some cool stuff if you make anything from this video : )

About The Author

You might be interested in