Combining Hand Pose and Physical Controls for Live Drawing Prototype in TouchDesigner

Draw with Your Hands — No Brushes Needed!

What if you could paint in thin air? This project turns your hands into a brush using real-time hand tracking and a tiny wireless controller. Move your hands to draw, tap a button to change colors, trigger effects, and watch your art appear live in TouchDesigner.

Powered by a Seeed XIAO ESP32S3 and a Python-based vision system, it sends your gestures straight to the screen via OSC, so every move becomes part of your masterpiece.

It’s part of the Interactive Signage Contest, where creators reimagine how we share information, with motion, light, sound, and gestures. Over 80 projects are already in, from emotion-sensing plants to gesture-controlled bikes.

https://www.seeedstudio.com/interactive-signage-contest-2025
Deadline: August 15 — 9 days left!
$4,000+ prize pool
First Prize worth $2,300 (includes a trip to Maker Faire Shenzhen, cash price and limitied swags!)

#community #project #contest #interactive