Mjuvi is a 2010 student project at h-da where music and visuals are generated by motion tracked people. The user can choose between different roles (beat = red ring, melodies = blue ring, effect = green ring or instrument switch = orange ring). Together they control a music program over midi signals.
The tracking system is scalable, e.g. the system also supports a reactable as input and supports up to 20 cameras (each camera connected to a tracking-server which sends tracked data to the main application over TCP). The tracking system is able to use AR ToolKit or reacTIVision.
For visual output the main application works as a server for VVVV, Processing or Java clients allowing them to display objects, connections and played midi-notes. The prototype uses four cameras as input and two Processing clients as output (ground and visuals projection). Main application and tracking system were developed in C++.
- flight404 at Decode / V&A [Events, News] Robert Hodgin aka flight404 has just posted this video of an application he is working for the Decode event at London's V&A to open next month. Robert was asked to rework his older Solar piece so that it could be audio responsive in real-time. Whilst the details of the actual exibit are yet unknown, it is nevertheless exciting to see Robert's work at the V&A. Video at the bottom is the older piece but do make sure you watch at HD / full screen. He will be joined by the names such as Golan Levin, Daniel Brown, Daniel Rozin, Troika and Simon Heijdens. More about the event here. 8 December 2009 - 11 April 2010 // Curated in collaboration with onedotzero (via Homage to Radiolab « all manner of […]
- Orbitone [vvvv, Sound] Orbitone is an ambient interface for musical interaction by means of tangibles and user motion. It was developed with vvvv, reacTIVision, OpenCV and Ableton Live. Media System Design, Media Arts & Science, University of Applied Science Darmstadt, Germany 2009-2010 (via 7nts on […]
- AudioDome SoundBlox [Sound, Objects] SoundBlox is a project by Bodo Lensch, Till Bovermann, René Tünnermann and an ongoing research by Tangible Auditory Interfaces exploring audio as a natural affiliate to physical objects. It is based on work, Till Bovermann developed and implemented during his PhD time at Bielefeld University. The site includes many projects and variations on the theme that somewhat deserve a post of their own. SoundBlox is an interactive installation developed at Animax, Bonn in cooperation with the Ambient Intelligence Group of the CITEC, Bielefeld. The installation offers the public opportunity to engage with sound loops via 60cm crates laid out in the 6x6m space. SoundBlox behaves like music sequencer, where each cube triggers a sound loop, depending on their position and orientation. See video below. Included are also prototyping images which you can also find here. Markers, as well as marker tracking were drawn from the reacTIvision […]
- Harmophon [vvvv, Sound] The video below, created by Lasal, shows a short part of a new installation which explores the relationship between 2 Harmonic waves in different graphical/musical ways. The piece includes 98 pair of points trigger notes depending on the collision position in the Y axis and panning depends on the X position. The phase and velocity of booth waves are synchronised to collide in a harmonic chord. The chaotic converges in harmonic, the complexity converges in simplicity. Created using vvvv. Previously on CAN: Hexagrama [vvvv, […]
- Spotify Player [Processing, Objects] Spotify Player is the work of Jordi Parra and his degree project: a device to listen to Spotify at home. In a nutshell the objects consists of Processing sketch, Arduino and an RFID reader. Each RFID tag can be assigned to a Spotify link, album, artist or search. When the tag is placed on the reader, an ID-12, it sends a trigger to Processing and triggers an AppleScript that will take over Spotify and play whatever is linked to that tag. The processing sketch can also retrieve the information about the track that is being played. For doing so, a packet sniffer is checking all the internet packets sent from the computer and whenever it finds something being sent to Last.fm, it grabs it and parses the track information (artist, album, title and length). The two small buttons on the bottom left of the device skip to the previous and next track in the queue. The big know is the volume, and the magnets are place on top of it. The knob has a magnet so the RFID tags stick to it. The object also includes three LED matrices, a total of 192 LED’s, to display information under the pattern of the speaker. In the video below you can see the LED’s turning on individually. It is just testing them to see if everything is working, but eventually they will be used to display battery levels, internet connection problems, premium subscription days left and other information. The project is now 99% complete. Read more about the detailed making process on Jordi's blog. (thanks […]
- Years [vvvv, Arduino] Created by Bartholomäus Traubeck, Years is a record player that translates wood's year rings into sound. Using a ps eye camera, the grain on the slices of wood is read and converted into music. Includes modified turntable, computer, camera, acrylic glass, veneer, approx. 90x50x50 cm. Technical components include arduino, ps eye, stepper motor for moving the tonearm, vvvv and ableton live, all connected via midiyoke and/or serial. A tree’s year rings are analysed for their strength, thickness and rate of growth. This data serves as basis for a generative process that outputs piano music based on the year ring data. Those are analyzed for their thickness and growth rate and are then mapped to a scale which is again defined by the overall appeareance of the wood (ranging from dark to light and from strong texture to light texture). The foundation for the music is certainly found in the defined ruleset of programming and hardware setup, but the data acquired from every tree interprets this ruleset very differently. Project Page Bartholomäus Traubeck, born in Munich, Germany in 1987. Currently living and studying in Rotterdam, Netherlands and Linz, […]
- Clavilux 2000 [vvvv] Clavilux 2000 is the latest project by Jonas Friedemann Heuer who we already mentioned in the post about Noteput [vvvv], an interactive music table with tangible notes. Clavilux 2000 is an interactive instrument for generative music visualization created using the graphical programming environment - vvvv. The music visualization consists of a digital piano with 88 keys and midi output, a computer running a vvvv patch and a vertical projection above the keyboard. For every note played on the keyboard a new visual element appears in form of a stripe, which follows in its dimensions, position and colour the way the particular key was stroke: The length and vertical position show the velocity, the stripe’s width reflects the length of each note. Furthermore the system allows the piano player to switch between the standart 2d view and an additional 3d view of the visualization while playing. Read more.. The Clavilux 2000 project was supervised by Prof. Michael Götte and Veldana […]
- Augmented Anamorphosis [openFrameworks] Augmented Anamorphosis (distorted projection) is a graduation project by Sander ter Braak at the Hogeschool voor de Kunsten Utrecht. The project explores projection of a 3d object in space dependant on viewer's location. In the movie embeded below the first scene shows a simulation, the second a user view, the third from a different angle showing the anamorphosis. I really enjoy the simplicity of it all. Even though we have seen a number of similar projects in the past this one clearly demonstrates the concept of augumented objects in space. Created with openFrameworks with openCV. (via […]
Posted on: 04/03/2010
- Senior Digital Designer at CLEVER°FRANKE
- Interaction Designer at Carlo Ratti Associati
- Creative Technologist at Deeplocal
- HTML / CSS Developer at Resn
- Climate Service Data Visualiser at FutureEverything
- Web Developer at &Associates
- Creative Technologist at Rewind FX
- Coder to collaborate with Agnes Chavez
- Data Scientist at Seed Scientific
- Data Engineer at Seed Scientific
- Design Technologist at Seed Scientific
- Creative Technologist, The ZOO at Google