Audio Reactive Animations with Stable Diffusion and TouchDesigner – Tutorial 3

Hey! In this tutorial, we’ll go over how to use Stable Diffusion with a custom component to generate audio-reactive animations in TouchDesigner.

Project File: https://drive.google.com/drive/folders/1mUU5ApNJXAQPCrKVuc-8sUNkizdVH7JP?usp=sharing

Link to The first Tutorial: https://www.youtube.com/watch?v=mRXTR9vcHAs
Link to the API: https://computerender.com/
Link to my Patreon: https://patreon.com/tblankensmith

Prompt Engineering with Lexica: https://lexica.art/
Opt out of Ai Training: https://haveibeentrained.com/

Huge thank you to Peter Whidden for his support on this and his work on Computerender which makes this project possible!!

0:00 Overview and Examples
2:42 Prompt Selection with Lexica
4:46 Setting up the Component
6:53 Creating a Zoom Effect
8:28: Creating a Distortion / Warble Effect
11:09 Breakdown of Displace TOP
16:38 Creating a Perfect Loop
17:50 Overview of Animation Recording Network
20:29 Bringing in the Zoom, Rotation, and Displacement Effects
21:20 Bringing in the Rotation Effect
23:21 Adding New Prompts
24:40 Making a Perfect Loop
27:20 Adding Audio Reactivity