Mapping Steel Data into Agent Behaviour: Interactive Sonification Test #mediapipe #touchdesigner

This video showed one of my early tests for the adaptation of the BDSS (Behaviour Driven Systemic Sonification) interactive installation in TouchDesigner during the Cont.Rolling exhibition development period in July 2025. I used MediaPipe Hands to track my hand movements and influence the three BDSS agents, shown as orbs. The agents followed their own internal pull values from the BDSS engine, but their positions shifted slightly when my hand came close. When the agents aligned, a bell sound was triggered.

The background audio was also generated by BDSS in real time. It responded to the agents as they moved through the xyz space mapped from simulated hot rolling process data, created in collaboration with POSCO master artisan Kwon Young Kook. This test formed part of the groundwork for the final Cont.Rolling exhibition.

Read more about BDSS and my works on my website 🙂
https://www.heund.net/