Blake Marques Carrington

TD as Game Engine, Part 3: First Person Camera

A series of tutorials diving into a very large project (over 6000 operators), in which TouchDesigner is used to create a first-person game-like experience for installation and performance contexts. Part 3 investigates the “FPC_LOCATION_CONTROL” container, which handles how our joystick input gets translated into camera movement in the world coordinate system. 00:00 Intro 00:29 Map […]

TD as Game Engine, Part 2: Input

A series of tutorials diving into a very large project (over 6000 operators), in which TouchDesigner is used to create a first-person game-like experience for installation and performance contexts. Part 2 covers the use of a Joystick CHOP and Keyboard In CHOP to create a flexible control input system. 00:00 Data from XBox controller 03:18 […]

TD as Game Engine, Part 1: Structure

A series of tutorials diving into a very large project (over 6000 operators), in which TouchDesigner is used to create a first-person game-like experience for installation and performance contexts. Part 1 gives an overview of the project and the various topics that I hope to cover in the series, including: – First Person Camera (FPC) […]

Real-time ASCII Art Effect

Demo on how to create a real-time ASCII Art effect in TouchDesigner from webcam input. Complete control over mapping arbitrary characters to quantized pixel values. 00:00 ASCII Art & Vuk Cosic 00:50 Overview 02:00 Instancing Texture Coordinates via CHOP 02:55 Texture3D TOP 06:30 Fill Texture3D TOP w Table DAT and Select DAT 10:00 Fine-tuning “w” […]

Oak-D + TouchDesigner Part 04: Run Other Object Detection Models

A continuation of Part 3 running object detection on the Oak-D camera. This time we’re browsing the Roboflow universe and using a public model there to detect playing cards, then creating some audiovisual events in TouchDesigner that respond to specific combinations of cards — 3 of a Kind, Straight, and Royal Flush. The document used […]

Oak-D + TouchDesigner Part 3: Object Detection

Running TinyYOLO object detection model on the Oak-D camera. How to send detection data and video frames to TouchDesigner using Python-OSC and NDI-Python, in order to process it further and use it in a creative audiovisual workflow. The document used in the video with steps written out can be found here: https://drive.google.com/file/d/1bbrbPa7St60KCn2_Tt3zxJZCpASS6V7n/view?usp=share_link And the “tiny_yolo_edit02.py” […]

Oak-D + TouchDesigner Part 1: Getting Started

First steps in setting up and using an Oak-D AI-powered camera by Luxonis. This series will explore how to use various AI models running on the Oak-D hardware, then send video frames and data to TouchDesigner for further processing in a creative audiovisual workflow. The document used in the video with steps written out can […]

Oak-D + TouchDesigner Part 2: Sending Depth and RGB Frames via NDI

How to combine example code from the ndi-python library and DepthAI examples to send depth and RGB video streams from the Oak-D camera to TouchDesigner. This series will explore how to use various AI models running on the Oak-D hardware, then send video frames and data to TouchDesigner for further processing in a creative audiovisual […]