The KAIST Mobile Phone Orchestra (KAMPO) aims to explore the potential of mobile media for music and media art. In addition to suggesting new and innovative mobile performance paradigms through concerts, KAMPO conducts active research/education in music and mobile media as well as software development.
The performances include five participants equipped with iPhones operating different components of the iPhone app, playing different instruments. Besides just triggering instrument sets in Ablenton Live, the main display application also creates a loop, as in a real orchestra, sending conduction messages back to performers and their devices.
The iPhone app used in the performance is made using Apple iOS framework together with Momu Toolkit of Standford, MoPho (Mobile Phone Orchestra) for some functionality, especially OSC. The app is available for purchase on the AppStore and includes five separate interfaces (button, drawing, mic, accelerometer, compass) and one setting interface.
The main display app uses Processing and receives performers’ OSC messages to visualize the data. This main application sends conduction message to performers’ iPhone via OSC, such as ‘Start’ message, buttons to press, lines to draw, direction to tilt, level to blow, direction of compass. Sounds are generated from the main computer running the main application, by using Ableton Live via MIDI message.
KAMPO was the thesis (PDF) project of Sihwa Park as well as an AIM (Audio & Interactive Multimedia) Lab project. The team are currently preparing several performances using not only this app but also other applications.
- Quasar [Processing, Sound] Quasar is an audiovisual artwork created by envis precisely using Processing and Ableton Live for the fourth issue of WEAVE magazine (weave.de). The team writes: It is an audiovisual composition that is based on a single set of MIDI notes. Those notes influence both music and graphics at the same time. We did not take the usual route of creating a piece of music first and then find some visualization for it; instead both elements have been developed at the same time. When we decided to change something with the graphics, the changes immediately influenced the music as well. envis precisely is a studio for interactive art and design based in Munich, Germany, founded in 2009 by Thomas Gläser, Markus Jaritz and Philipp E Sackl. See also their first iPhone App: […]
- Konkreet Performer [iPad, Sound] Konkreet Performer is an OSC music control and performance instrument created by Berlin based Konkreet Labs collective. Instead of faders and knobs, Performer allows you to remotely operate music or visual software on your computer, using interactive visualisations. Any software that allows OSC input can be controlled. These include more traditional music making apps such as Ableton Live (shown in the video) or custom built applications created using Processing, oF, MaxMSP or other. The heart of Performer is the control object, an abstract graphic element, made out of up to 10 nodes. Combine up to 3 graphical layers to design the look of this object. This object can be moved around as a whole. Zoom, turn, throw, distort and reshape it across the screen. The app also has the ability to save the shape of your objects (and hence the sound that they represent) into 8 snapshots, organised into 8 banks, i.e. 64 slots in total. In addition there is also ribbon controller allowing you to for example control pitch bend while simultaneously manipulating the other sound parameters using the Performer object. Also coming soon to the Performer is native MIDI Support as well as “Visualiser”, a Mac/PC application that mirrors everything you’re doing on the iPad screen. Platform: iPad Version: 1.0 Cost: $24.99 Developer: Konkreet Labs Previously: Konkreet Performer - "new control instrument for […]
- Yellow Tail [iPhone, iPad, openFrameworks] In the multifaceted world of iOS apps for iPhone, iPad and the iPod Touch, artists are beginning to carve a niche in the crowded landscape of Apple's Appstore. One trend amongst software artists is to repurpose work that was originally written for desktop computers into small, compact versions that run smoothly on these mobile devices. Although some of these artist-designed apps utilize the location-aware and networked capabilities that these devices offer, several artists are revisiting the interactive and non-connected aspects of their art. One such piece is "Yellowtail" by Pittsburgh-based media artist, Golan Levin. Reexaming his project "Yellowtail", originally released in 1998 as part of his "Audio-Visual Suite" of applications for the desktop computer, Levin has recreated the piece specifically for the iPhone. From his description: "Yellowtail repeats a user's strokes end-over-end, enabling simultaneous specification of a line's shape and quality of movement. Each line repeats according to its own period, producing an ever-changing and responsive display of lively, worm-like textures." The experience of using Yellowtail is a fluid reminder of what made software-based art such an immersive experience back in the day. Also revisiting his old screen-based work from the 1990s was Scottt Snibbe's who has released several apps for the store that have even made it to Apple's top download list. Maybe as Golan has said in the past, it's about time for Apple to introduce an "Art" category to the store. Current artist apps are automatically put into the "Entertainment" category of the store which is true to some degree, but hardly does most of these apps justice as a designation. At its core, Yellowtail it is an interactive software system for the gestural creation and performance of real-time abstract animation. Using a playful animated transformation of the user’s gesture, the software produces an ever-changing and responsive display of lively, worm-like textures. More general information about Yellowtail is available here, and a whole heap of really technical and historical context is here. Yellowtail was originally developed as a skunkwork project at Interval Research Corporation (1998) with support from Michael Naimark, and later at the MIT Media Laboratory (1999-2000) with support from John Maeda’s Aesthetics and Computation Group (ACG). The iOS ports were developed in openFrameworks and were created with the assistance of Max Hawkins, Lee Byron, Jonathan Brodsky, and enabling support from the OF iPhone crew (Memo Akten, Zach Gage, Theo Watson, Zachary Lieberman, and many others). Yellowtail can be experienced (with source code) in this interactive Java applet. or Download Yellowtail (Full-screen PC .exe, 2000) This is the full-screen, sonified version of Yellowtail, the first instrument in the Audiovisual Environment Suite (AVES). [196k zip file, for Windows2000/XP. Requires 700Mhz+ CPU; an nVidia geForce or other OpenGL graphics card; and a Soundblaster-compatible sound card.] Platform: iPhone/iPad (Universal) Version: 1.0 Cost: $0.99 Developer: Golan […]
- nanoKey Experiments [Processing, Sound] Created by Amnon Owed, this is an experiment using KORG nanoKEY and Processing to create visual interpretation of sound into objects. While a tone is played, all objects originating from that tone grow in size. The strength that is used to tap the keys (velocity) affects the object’s initial location on the screen. So depending on how the keyboard is played, different visual compositions are created. In this case, Amnon is playing with black and white circles resulting in some quite bold but beautiful graphic compositions. The midi signal is sent to Ableton Live simultaneously. I wasn’t feeling the audio though, so I decided to use another track instead. In the end it works out pretty well. Starting out purely as a proof-of-concept experiment, I didn’t really go overboard with the complexity of the visuals. I’m a sucker for circles anyway, but with the black-and-white the result is pretty stylish in my opinion. Amnon Owed is a graphic designer currently located in the Hague, the Netherlands. His interests are graphic design, visual programming, sound design, motion graphics & animation. See more of his work at amnonp5.wordpress.com, his Flickr and […]
- NNN Mono and Powon [iPhone, Sound] From the creators of iOSC, an iPhone application that can communicate with other compatible hardware and software nodes on your network, come two new sound application: Powon and NNN Mono. Considering Powon is a free app, this makes it a must download. If you are looking for creative synthesiser app, NNN Mono definitely deserves a closer look. There are plenty of videos on the site (see some below), that should give you a good overview of features the app includes. Here is some more info on each app. NNN Mono, a more complex monophonic synthesizer and musical instrument. Costing $3.99, the app includes a number of oscillators (with OSC output), low pass, high pass, band pass, band stop filters, three envelope generators, a number of modulations, arpeggiators, delay and other features wrapped in a gorgeous minimal interface. You can save your settings and your creations are created in 44.1kHz stereo. To see full specification and tutorials, check out this instruction booklet (PDF) and plenty of videos available on the site, two of which are embeded below. Platform: iPhone Version: 1.0.1 Cost: $3.99 Developer: OKAHON Powon Free experimental sound toy with OSC output Powon is a sound toy, a free app that allows you to generate sound using waves. You can play simple music with 1 octave. It includes eight kinds of sounds, you can change the screen color, adjust the wave movement, use as a simple OSC controller by entering the iP address and port number. You can remote control the middleware such as Max MSP, Processing, ActionScript (FLOSC) and many other devices that support the OSC protocol from your iPhone. There is also an application for Windows, Mac that can be operated with Powan and you can download it here (see video below) Platform: iPhone Version: 1.0.1 Cost: […]
- MSA Remote [iPhone] After a number of rejections, MSA Remote by Mehmet Akten is now finally available in the AppStore! MSA RemoteÂ is a remote control application for iPhone & iPod Touch that sends OSC messages over the wifi network. This allows you to control any OSC supporting applications such as Max/MSP/Jitter, PureData, Reaktor, VDMX, vvvv, Resolume, Quartz Composer etc. By mapping the OSC to midi on desktop (e.g. using OSCulator) allows further control of any application which supports midi such as Ableton Live, Cubase, Logic Pro, 3DSMax etc. In addition, developers can easily integrate OSC into their applications knowing it can be controlled remotely. Features: - Multitouch information sent using standard TUIO protocol for instant integration with existing TUIO clients - Accelerometer data for each axis (x, y, z) is sent - 64 faders (8 pages of 8 faders) - 64 triggers (8 pages of 8 triggers) - 108 key (9 octaves) VELOCITY SENSITIVE polyphonic keyboard. Yes, the harder you hit the keys, the greater the velocity. - Settings are automatically saved and restored - Multitouch area orientation can be set as desired - All information on protocols are documented in the app See alsoÂ iOSC [iPhone],Â synthPond [iPhone, MaxMSP] Platform: iPhone Version: 1.0 Cost: $1.99 Developer: Memo (Mehmet) Akten MSAFluid for processing (Controlled by iPhone) from Memo Akten on Vimeo. Graffiti Wall meets MSA Remote from Alex Beim on […]
- Konkreet Performer [iPhone, iPad, Sound] Very first glance at Konkreet Performer iPhone/iPad app by Konkreet Labs, visual OSC controller and visualizer for your DAW / Synth / Drum Machine / Sampler etc. Konkreet Performer is a control instrument for live music performance. Its unique and intuitive multi-touch interface reconnects the musician’s actions directly with the music. Taking full advantage of the possibilities created by the latest multi-touch technology, Konkreet Performer delivers a revolutionary new way to control your DAWs, synthesizers, samplers (anything that receives MIDI/OSC). More than a studio controller, Konkreet Performer has been designed from the ground up to be a superior live performance instrument, bringing the dynamic audio and visual connection between the musician and the audience to the stage. It will be released as an iOS App at the beginning of 2011. Coming soon for iPad / iPhone / iPod Touch konkreetlabs.com/ (Thanks […]
- Extending the Touchscreen [oF, Arduino, iPad, iPhone] 'Extending the Touchscreen' is an ITP Thesis project by Michael Knuepfel which includes seven devices designed to improve upon or supplement the functionality of capacitance touchscreens; game controller, digital signet rings, mechanical stylus, sound stylus, pulse generator, dial-a-rama and future devices. Touchscreens like those found on smartphones and tablets have enabled a new generation of versatile user interfaces. My thesis project, Extending the Touchscreen, aims to further this versatility by using conductive materials to construct a series of physical, mechanical, and electrical devices that touch, interact and communicate directly through the touchscreen interface. My goal in constructing these external devices is to make touchscreen interactions more tactile, physical and potentially more expressive and fun. Instead of utilising USB connection to extend the functionality of iPad and iPhone, the devices rely on the software, simple light senors or magnets to allow objects to communicate between each other. Some devices are just used as tools to unlock the iphone for example, others allow robot like objects to behave in a certain way by 'reading' information from iPad's screen. See video for more + follow Michael's blog for […]
Posted on: 30/04/2011
- WebGL/3D Creative Prototyping Devs at TheSupply
- Freelance Interactive Producers at Psyop
- Senior Digital Designer at CLEVER°FRANKE
- Interaction Designer at Carlo Ratti Associati
- Creative Technologist at Deeplocal
- Jr. / Sr. Software Developer at Minivegas
- Web Developer at Minivegas
- Digital Producer at Minivegas
- 3D Technologist at INDG
- Creative Director at INDG
- Lead Developer at INDG
- Web Developer at &Associates