Real-time AI Avatar & Audio-Reactive Strobe | Stream Diffusion + TouchDesigner

This project combines real-time AI video generation with advanced audio-reactive control. The top video shows an infrared camera feed, while the bottom displays a real-time AI-generated knight in armor, driven by Stream Diffusion and an audio-synced strobe effect.

Hardware Setup:

Primary GPU: NVIDIA RTX 3080 Ti (Stream Diffusion)

Secondary GPU: NVIDIA RTX 5060 Ti (Resolume assistance)

Technical Credits & Resources:

AI Integration: Based on Stream Diffusion for TouchDesigner by Scott Mann and The Interactive & Immersive HQ.

Tutorial: https://www.youtube.com/watch?v=LCar8AIcRto

Beat Detection: Precise drum element extraction (kick, snare, hi-hat) using Lag and Slope CHOPs as taught by Bileam Tschepe (Elekktronaut).

Audio Lab Component: https://www.patreon.com/posts/140085109

Strobe Effect: Integrated audio detection within the strobe tool by MAZE.

Strobe Tox: https://www.patreon.com/posts/strobe-effect-146792114

Audio: World and Back featuring Riko Dan

#TouchDesigner #StreamDiffusion #StableDiffusion #RealTimeAI #VFX #GenerativeArt #AudioReactive #NVIDIA3080Ti #Resolume