Please disable AdBlock. CAN is an ad-supported site that takes hundreds of hours and thousands of dollars to sustain. Read More.
HOLO is a biannual magazine about emerging trajectories in art, science, and technology brought to you by the people behind CAN. Learn more!

Speakatron [Sound, openFrameworks, Mac]

Created for Music Hack Day, Speakatron is a Mac application by Marek Bereza which allows you to play sounds using your mouth only. Made with openFrameworks the app uses your webcam to look to see if your mouth is open and then plays a sound if it is.

Download the app or source here.

To get it to work you may have to press spacebar to enable the GUI, then adjust the threshold slider until it starts working. You will also need to adjust the “threshold” slider, probably needs to be between 3 and 20. If you close your mouth and then slide it so it just stops triggering until you open your mouth – see movie below.

Press 1, 2, 3 or 4 to try different sounds – I got a cat, a synth, birdsong and buddhist monks. Open the data/patches folder to reveal the pd patches that drive the audio.

Created with openframeworks, opencv and libzengarden for the audio. libzengarden is a complete re-write of puredata in C++ so you can integrate it into your own apps without the whole giant leviathan of Pd running in the background.

Posted on: 15/09/2010

Posted in: Mac, openFrameworks, Sound

Post tags:

    • 1qsdq

      how does it work?

    • anon

      Doesn’t work on OS X 10.5.8

    • Fero

      just….lol