Created for Music Hack Day, Speakatron is a Mac application by Marek Bereza which allows you to play sounds using your mouth only. Made with openFrameworks the app uses your webcam to look to see if your mouth is open and then plays a sound if it is.
Download the app or source here.
To get it to work you may have to press spacebar to enable the GUI, then adjust the threshold slider until it starts working. You will also need to adjust the “threshold” slider, probably needs to be between 3 and 20. If you close your mouth and then slide it so it just stops triggering until you open your mouth – see movie below.
Press 1, 2, 3 or 4 to try different sounds – I got a cat, a synth, birdsong and buddhist monks. Open the data/patches folder to reveal the pd patches that drive the audio.
Created with openframeworks, opencv and libzengarden for the audio. libzengarden is a complete re-write of puredata in C++ so you can integrate it into your own apps without the whole giant leviathan of Pd running in the background.
- Trace Modeler [openFrameworks] Created by Karl D.D. Willis, Trace Modeler is an application that uses real-time video to create three-dimensional geometry. The silhouette of a foreground object in a video frame is subtracted from the background and used as a two-dimensional slice. At user-defined intervals new slices are captured and displaced along the depth axis. The result is a three-dimensional model defined by silhouette slices over time. Trace Modeler was built using the openFrameworks and the OpenCV library to recognize contours from the video image. Source code is available for download here. Project Page (re-descovered via Cedric Kiefer) See also Beautiful Modeler [iPad, […]
- refreq [Sound, openFrameworks, Mac] Created by Daniel Feles, refreq is a customisable music player. You can load music files into refreq, but also images (bitmaps, imgs, pngs). When you load a song, first the program analyzes the track, then it draws its frequency spectrum. After tracking, you can generate the spectral image / bitmap back into music. Likewise, if you load an image, according to pixel value to application scans the image based on the line you can position anywhere on the screen. Simultaneously you can move the line while the content is being played producing some quite interesting variations. I was listening to music, when I fell asleep. When the track was over, I woke up and just realized, this music would be really cool for a documentation video, but we have to rotate it 90 degree. At this point, it's getting really interesting. After you have the image of the track, how you want to play it depends on you, You can play with the timeline, to play the sound from another aspect. Daniel is also looking for collaborators for this opensource project, to bring windows and linux versions of the software. You can download the source here and get in touch with Daniel via his site. Project Page Created […]
- Mo Money Mo Problems [openFrameworks] Created by Nick Hardeman, these images are generated by evaluating and interpreting the 1997 music video “Mo Money Mo Problems” from the first disc of the Notorious B.I.G. album, Life After Death. The algorithm detects edges in the image and attempts to trace motion from frame to frame, using the initial frame as their starting point. The output is rendered as a vector image, the curves represent the motion. The points represent the pixels detected in the edge, their size determined by the distance from their previous location, the further, the larger the circle. The color and location of the points are determined by the corresponding pixel in that frame. The bright colored track suits worn by Puff Daddy and Mase in the dark backgrounds make for good tracking and nice color combinations. The only imagery added manually is the background color. You can check out some more renders in the Mo Money Mo Problems photoset on flickr. Nick Hardeman was born and raised in Miami, FL and grew up studying fine art. He received a BFA in graphic design from Florida State University in 2006. He then worked as a Flash web developer in Miami, FL at WA007. He is currently living in New York, NY and is pursuing a MFA in Design and Technology from Parsons The New School for Design and is expected to graduate in […]
- hutuxian’s sound experiments [openFrameworks, Sound] Just came across these two openFrameworks examples by hutuxian. The first utilises openCV to allow you to 'draw sounds' by drawing objects on paper and let application interpret them as objects in the scene amongst which balls bounce and produce sounds. The second project uses reactTIVison identifiers to mix tracks together. See videos below. If you are interested in the first draw/visual sound example, make sure you also check out Zach's + Golan's MANUAL INPUT STATION from some time […]
- Tunetrace – iOS app by Ed Burton converts drawings to music Created by Ed Burton, formerly of SodaPlay, and now at Queen Mary, University of London, Tunetrace transforms photographs of drawings into […]
- Wake Up With the World – Collaborative, musical, waking experience Wake Up With the World is a an iOS application that turns your wake up alarm into musical collaborative experience. When you wake your GPS coordinates are translated into musical notes and combined with those of every other person waking up at the same moment as […]
- Orany – goniąc kormorany 2.0 [openFrameworks] Jakub Koźniewski & Piotr Barszczewski members of panGenerator were invited by Narodowy Instytut Audiowizualny (Polish National Audiovisual Institute) to create three interactive installations for Culture 2.0 conference and the Enter Level 2.0 exhibition. One of these installations was ORANY - goniąc kormorany 2.0 ( Chasing Cormorans 2.0 ) which included an old gramophone hacked to only play the record as visitors were moving around it. The team chose old Polish hit by Piotr Szczepanik "Goniąc Kormorany" ( Chasing Cormorans ) and engraved it on a custom vinyl plate ( made by lay-belle.com ).They then hacked the old gramophone, replacing the engine with the one controlled via Arduino. Special tracking software was written in openframeworks which allowed the tracking of visitors as they were moving around the gramophone. Their movement was transposed to speed/direction of the rotating vinyl plate, so the one could "remix" the recording by just running around. credits: Jakub Koźniewski & Piotr Barszczewski ( with support from Krzysztof Goliński & Krzysztof Cybulski ) For other two installations, see video below. (Thanks […]
- Holler Logo Bash [openFrameworks] Lukasz Karluk aka julapy has been doing some interesting experiments with openCV. To start, he wanted to play with some basic shapes and since he was doing all this in work downtime he felt a little obliged to use the agency's logo. The end result in an interesting collage of both motion tracking, delaunay triangulations and particle effects generated by motion in front of camera (see videos below). The two interactive demos included below use openCV for the camera interaction. He writes: 1) first step is to work out the frame differencing, basically taking away the last two frames in the camera stream and working out the difference in the image. its a way of allowing the camera to see movement. 2) next step is to work out the common area of intersect between the movement image and the holler logo. by applying the & operator, both images are checked for common areas containing white pixels. 3) contour analysis is then applied on the common area of intersect. it searches out all the white blobs in that image and returns the result as a series of points which when connected show an outline of the blobs and mathematically describe what each blob/shape looks like. 4) now that each white blob is described as a bunch of points, that data can be passed to a delaunay triangulation algorithm which calculates the triangles necessary to fill that shape. 5) finally optical flow is used to add velocity to the box2d elements. Read the full post on his blog with detail descriptions of each step. See also Triangle Field [openFrameworks] also by […]
Posted on: 15/09/2010
- Senior Digital Designer at CLEVER°FRANKE
- Interaction Designer at Carlo Ratti Associati
- Creative Technologist at Deeplocal
- HTML / CSS Developer at Resn
- Climate Service Data Visualiser at FutureEverything
- Web Developer at &Associates
- Creative Technologist at Rewind FX
- Coder to collaborate with Agnes Chavez
- Data Scientist at Seed Scientific
- Data Engineer at Seed Scientific
- Design Technologist at Seed Scientific
- Creative Technologist, The ZOO at Google