Created for Music Hack Day, Speakatron is a Mac application by Marek Bereza which allows you to play sounds using your mouth only. Made with openFrameworks the app uses your webcam to look to see if your mouth is open and then plays a sound if it is.
Download the app or source here.
To get it to work you may have to press spacebar to enable the GUI, then adjust the threshold slider until it starts working. You will also need to adjust the “threshold” slider, probably needs to be between 3 and 20. If you close your mouth and then slide it so it just stops triggering until you open your mouth – see movie below.
Press 1, 2, 3 or 4 to try different sounds – I got a cat, a synth, birdsong and buddhist monks. Open the data/patches folder to reveal the pd patches that drive the audio.
Created with openframeworks, opencv and libzengarden for the audio. libzengarden is a complete re-write of puredata in C++ so you can integrate it into your own apps without the whole giant leviathan of Pd running in the background.