Watercolor Hand Tracking Brush in TouchDesigner Tutorial

In this beginner tutorial, we’ll dive into hand tracking with MediaPipe and building an interactive watercolor effect in TouchDesigner! You’ll learn how to create a custom hand-tracked brush to paint dynamically on screen, with brush size control, gesture-based clearing, and even video textures as brushes.

📌 Resources & Links:
– Clamp Math Component (Free Download) – [https://www.patreon.com/posts/clamp-math-tox-123882886]
– Full Project File – Available for Patreon supporters – [https://www.patreon.com/posts/watercolor-hand-124232121]
– MediaPipe Plugin for TouchDesigner – [https://github.com/torinmb/mediapipe-touchdesigner]
– Previous MediaPipe Tutorial (Full tracking breakdown) – [https://www.youtube.com/watch?v=Cx4Ellaj6kk]
– 3-Part Hand Tracking Masterclass – [https://www.youtube.com/watch?v=e2FtkufeErY&list=PLgfxkm9xFocaQXGTxu7HlFomE05kPbO8z]

The MediaPipe plugin for TouchDesigner is co-created by myself and Dom Scott
Check out Dom’s work:
Website – [https://www.domscott.ca/]
Instagram – www.instagram.com/domscott.art

0:00 Intro & Watercolor Brush Demo
1:30 Project Setup & MediaPipe Plugin
4:00 Basic Hand Tracking Output
8:26 Mapping Hand Position to Brush Stroke
13:12 Adding Feedback for Continuous Drawing
18:35 Incorporating Video Textures into the Brush
24:15 Creating a Watercolor Effect with Displacement & Blur
26:40 Final Adjustments & Performance Mode

About The Author

You might be interested in