Just came across these two openFrameworks examples by hutuxian. The first utilises openCV to allow you to ‘draw sounds’ by drawing objects on paper and let application interpret them as objects in the scene amongst which balls bounce and produce sounds. The second project uses reactTIVison identifiers to mix tracks together. See videos below.

If you are interested in the first draw/visual sound example, make sure you also check out Zach’s + Golan’s MANUAL INPUT STATION from some time ago.

SoundBlox is a project by Bodo Lensch, Till Bovermann, René Tünnermann and an ongoing research by Tangible Auditory Interfaces exploring audio as a natural affiliate to physical objects. It is based on work, Till Bovermann developed and implemented during his PhD time at Bielefeld University. The site includes many projects and variations on the theme that somewhat deserve a post of their own. SoundBlox is an interactive installation developed at Animax, Bonn in cooperation with the Ambient Intelligence Group of the CITEC, Bielefeld. The installation offers the public opportunity to engage with sound loops via 60cm crates laid out in the 6x6m space. SoundBlox behaves like music sequencer, where each cube triggers a sound loop, depending on their position and orientation. See video below. Included are also prototyping images which you can also find here.

Markers, as well as marker tracking were drawn from the reacTIvision project.

Infractor is an interactive, artistic application that has been developed for a multitouch-table. It is based on the article database of the New York Times. The information can be searched, filtered and read by putting physical objects on the interactive surface.

The project has been carried out entirely in Processing. The reacTIVision-software was used for the tracking of the objects.

Infractor has been developed and designed by a group of students of the Potsdam University of Applied Sciences.

more at infractor.org

(thanks Mike)

Continue reading.... Virtual Gravity [Processing]