Hand Tracking in TouchDesigner – Master Class Part 1

In this first tutorial in a 3 part series, we’re taking a deep dive into hand tracking using the MediaPipe plugin for TouchDesigner. I’ll walk you through setting up hand tracking, smoothing data, building a custom clamp math component, and extending functionality with distance calculations for more accurate and interactive experiences.

This is Part 1 of a multi-part series—check out the next tutorial here: [https://youtu.be/XRw1AUa57Zw]

📌 Resources & Links:
– Patreon (Download the final project file) – [https://patreon.com/blankensmithing]
– MediaPipe Plugin for TouchDesigner – [https://github.com/torinmb/mediapipe-touchdesigner]
– Previous MediaPipe Tutorial (Full breakdown of tracking features) – [https://www.youtube.com/watch?v=Cx4Ellaj6kk]

The MediaPipe plugin for TouchDesigner is co-created by myself and Dom Scott @domscottart
You can check out Dom’s work here:
Website: https://www.domscott.ca/
Instagram: @domscott.art

Looking forward to seeing what you create! 🎉
Let me know in the comments if you have any questions.

0:00 Intro & Overview
1:04 Project Setup & MediaPipe Plugin
3:38 Importing & Configuring Hand Tracking
7:20 Smoothing & Stabilizing Tracking Data
8:21 Custom Remapping with Clamp Math
13:08 Extending Hand Tracking & Gesture Controls
16:37 Outro & Next Steps

About The Author