Generative Architecture and Hand Tracking in TouchDesigner with MediaPipe

In this tutorial, we’ll create a Brutalist-inspired Generative Architecture piece using TouchDesigner. We’ll explore instancing, physically based rendering (PBR), and hand tracking with MediaPipe for interaction.

Looking forward to seeing what you create! 🎉 Let me know in the comments if you have any questions.

📌 Resources & Links:
– Patreon (Download the project file + bonus dithering plugin) – [https://patreon.com/blankensmithing]
– Hand Tracking Masterclass (3-Part Series) – [https://www.youtube.com/watch?v=e2FtkufeErY&list=PLgfxkm9xFocaQXGTxu7HlFomE05kPbO8z]
– Derivative TouchDesigner Fundamentals Course – [https://learn.derivative.ca/]
– ShaderToy Dithering Examples – [https://www.shadertoy.com/results?query=dither]
– Dom Scott’s Work – Website: [https://www.domscott.ca/] | Instagram: [https://instagram.com/domscott.art]

0:00 Intro & Project Overview
2:42 Setting Up the Project & Hand Tracking Integration
4:30 Instancing & Physically Based Rendering (PBR)
7:01 Applying Concrete Textures & Normal Maps
10:30 Interactive Block Motion Using Noise & Rotation
14:15 Implementing Hand Rotation to Cycle Forms
18:02 Adding Animated Lights & Shadows for Depth
22:35 Dithering Shader Effect
25:20 Final Tweaks & Customizing the Interaction
28:40 Outro & Next Steps