matilde matilde on hover

Hand Synth

[python, js, html, max]

A granular synthesizer using hand landmarks detection with MediaPipe. This synth was created during the artist residency "Borderscape Improvisation - from analog music to livecoding" at University of Pavia's Department of Musicology and Cultural Heritage and IMPROCOMP where we spent several days doing musical improvisation.
I was mentored by Professor Walter Prati and I played this instrument during the performance held at the Camerata in Cremona on March 28, 2025.

The core of this project was developed in Python, using MediaPipe for hand tracking. I connected it to Max via the OSC (Open Sound Control) protocol, allowing for real-time control and sound manipulation.

Before arriving at the final version of Hand Synth, I did different experiments. The videos below document some of them.

sourcecode