Tonal Paintbrush
Created on 27 Nov 2015
Paint sounds in 3D space. Listen to your painting by moving the brush around your painting
There are 2 main components to this project: the desktop component (a computer connected to a Kinect and a set of speakers), and the handheld component (a paintbrush containing a WiFi transceiver, an MCU and a small circuit). The Kinect is used to track the user's hands, and the computer is used to operate the Kinect and produce sounds.
Setup:
The user holds the paintbrush in their right hand. The paintbrush has a small MCU, a WiFi transceiver and a small circuit containing a button and a potentiometer. The Kinect will face the user, tracking the position of their right hand.
When the user presses the button on the paintbrush, the transceiver communicates this to the computer (communication protocol TBA), and the current position of the paintbrush is recorded by the computer. The computer also produces a sound.
Now when the paintbrush is placed in the vicinity of the recorded position, the computer plays back the sound (allowing the user to explore their painting).