You can hold a chord for several seconds and still give it a beginning, a rise, and an ending. Let it brighten slowly, bring in a little vibrato near its peak, then let it settle. The notes stay the same; the phrase takes shape through the changes around them.
A keyboard's wheels, a pedal, or a hand on a knob can do that work. HandMod explores another possibility: using a camera to turn movements of the hands, face, and body into musical control. A head tilt or the opening of your mouth can shape a sound while your fingers continue playing.
Give a held note somewhere to go
Imagine a sustained synth part under a vocal. You might want it to stay subdued while the singer is active, then open into the space between lines. The movement follows the arrangement: a brighter sound becomes an answer to the voice.
Or imagine a melody whose final note needs more life. Bringing in vibrato after the note has settled can give the ending a different weight from using the same amount throughout the phrase.
These are reasons to explore a gesture. A broad movement might suit a long swell; a small, comfortable motion might suit a detail you want to repeat. The destination instrument determines which sound controls you can reach.
Movement has its own phrasing
The timing of the change matters as much as its size. Opening a filter before a note gives it a bright attack. Opening it after the note begins lets the brightness arrive inside the sound. The same destination can serve two different musical intentions.
Camera control also makes ordinary movements part of the decision. If you tend to move your head while playing, a head-tilt mapping may need a quieter role, a smaller range, or a different gesture. The response needs to fit your body and the way you perform.
Our take: begin with one movement that has a clear place in a phrase. More mappings become interesting once each one gives you a change you want to hear. The Camera and gesture control guide handles the practical setup: ranges, smoothing, and what happens when a gesture leaves the frame.
What we want to learn from playing
HandMod is part of our exploration of expressive interfaces. We want to understand which movements let people shape sound comfortably, particularly when their hands are already busy. A slow swell and a sharp accent ask for different kinds of response; experience with real phrases should guide those choices.
Try a short part on the HandMod page with one gesture connected to a control on your instrument. Play it once with that control held still, then shape only the ending. Keep the version that says more with the same notes.
Tracking depends on your camera, lighting, and keeping the gesture in view. When you enable it, the browser asks for camera permission and processes the camera input on your device.
