Text-to-Speech ElevenLabs Plugin for TouchDesigner + Whisper, ChatGPT, and MediaPipe Integration

In this tutorial, you’ll learn how to use the new ElevenLabs text-to-speech plugin for TouchDesigner. We’ll also walk through a project creating a voice-activated 3D talking character by integrating Whisper for speech-to-text, ChatGPT for generating dialogue, ElevenLabs for text-to-speech, and MediaPipe for motion tracking to create an interactive experience.

Link to project file + Plugin on Patreon: https://www.patreon.com/tblankensmith

Previous Tutorial on ChatGPT and Whisper: https://www.youtube.com/watch?v=34s2p9gzWhs
Noto the Talking Ball’s Tutorial: https://www.youtube.com/watch?v=va6cxORsFMw
MediaPipe Plugin Tutorial: https://www.youtube.com/watch?v=Cx4Ellaj6kk

0:00 Overview
3:11 ElevenLabs Plugin Overview
7:22 Connect ChatGPT to ElevenLabs
10:11 Configure Whisper with ElevenLabs
17:40 Add MediaPipe Face Tracking