Body-Tracking + StreamDiffusion in TouchDesigner & Daydream

Creating interactive, real-time AI content often feels like running into endless technical hurdles, but with today’s tools you can get StreamDiffusion running in TouchDesigner quickly, and with a little extra work, even make it interactive with body tracking.

In this tutorial, Andrew shows you how to set up skeleton tracking with MediaPipe and feed that data into StreamDiffusion, while also exploring Livepeer’s Daydream as both an intuitive content creation tool and a cloud-hosted platform built with TouchDesigner creators in mind.

The result is a flexible workflow for experimenting with generative AI at full speed, without being limited by your local hardware.

Links:
Daydream Playground: https://playground.daydream.live/

StreamDiffusionTD plugin: https://www.patreon.com/dotsimulate

Join the waitlist for early access to the Daydream API here: https://share.hsforms.com/2c2Uw6JsHTtiiAyAH0-4itA3o1go

Check out more of Andrew’s work here:
Instagram: https://www.instagram.com/as.ws__/
Patreon: https://www.patreon.com/c/asws__
His website: https://sunandrew.com/

#interactiveimmersivehq #touchdesigner #streamdiffusion