Blake Marques Carrington

MediaPipe in TouchDesigner

Mark Tutorial Completed! This tutorial covers the steps to getting started with the MediaPipe plugin in TouchDesigner and shows a couple of slightly more developed examples. Mediapipe TouchDesigner plugin created by Torin Blankensmith and available on his GitHub: https://github.com/torinmb/mediapipe-touchdesigner 00:00 What is MediaPipe? 01:27 Download from GitHub 02:35 MediaPipe demo project 03:41 Troubleshooting when stream […]

TD as Game Engine, Part 3: First Person Camera

Mark Tutorial Completed! A series of tutorials diving into a very large project (over 6000 operators), in which TouchDesigner is used to create a first-person game-like experience for installation and performance contexts. Part 3 investigates the “FPC_LOCATION_CONTROL” container, which handles how our joystick input gets translated into camera movement in the world coordinate system. 00:00 […]

TD as Game Engine, Part 2: Input

Mark Tutorial Completed! A series of tutorials diving into a very large project (over 6000 operators), in which TouchDesigner is used to create a first-person game-like experience for installation and performance contexts. Part 2 covers the use of a Joystick CHOP and Keyboard In CHOP to create a flexible control input system. 00:00 Data from […]

TD as Game Engine, Part 1: Structure

Mark Tutorial Completed! A series of tutorials diving into a very large project (over 6000 operators), in which TouchDesigner is used to create a first-person game-like experience for installation and performance contexts. Part 1 gives an overview of the project and the various topics that I hope to cover in the series, including: – First […]

Real-time ASCII Art Effect

Mark Tutorial Completed! Demo on how to create a real-time ASCII Art effect in TouchDesigner from webcam input. Complete control over mapping arbitrary characters to quantized pixel values. 00:00 ASCII Art & Vuk Cosic 00:50 Overview 02:00 Instancing Texture Coordinates via CHOP 02:55 Texture3D TOP 06:30 Fill Texture3D TOP w Table DAT and Select DAT […]

Oak-D + TouchDesigner Part 04: Run Other Object Detection Models

Mark Tutorial Completed! A continuation of Part 3 running object detection on the Oak-D camera. This time we’re browsing the Roboflow universe and using a public model there to detect playing cards, then creating some audiovisual events in TouchDesigner that respond to specific combinations of cards — 3 of a Kind, Straight, and Royal Flush. […]

Oak-D + TouchDesigner Part 3: Object Detection

Mark Tutorial Completed! Running TinyYOLO object detection model on the Oak-D camera. How to send detection data and video frames to TouchDesigner using Python-OSC and NDI-Python, in order to process it further and use it in a creative audiovisual workflow. The document used in the video with steps written out can be found here: https://drive.google.com/file/d/1bbrbPa7St60KCn2_Tt3zxJZCpASS6V7n/view?usp=share_link […]

Oak-D + TouchDesigner Part 1: Getting Started

Mark Tutorial Completed! First steps in setting up and using an Oak-D AI-powered camera by Luxonis. This series will explore how to use various AI models running on the Oak-D hardware, then send video frames and data to TouchDesigner for further processing in a creative audiovisual workflow. The document used in the video with steps […]

Oak-D + TouchDesigner Part 2: Sending Depth and RGB Frames via NDI

Mark Tutorial Completed! How to combine example code from the ndi-python library and DepthAI examples to send depth and RGB video streams from the Oak-D camera to TouchDesigner. This series will explore how to use various AI models running on the Oak-D hardware, then send video frames and data to TouchDesigner for further processing in […]

More CHOPs

Mark Tutorial Completed!