In the beginning I wanted to create a digital toy to record and play sound, with some creative controls like scratching. After playing the prototype for a while, I added more functions. In edit mode I can adjust the volume, attack, release, playing speed. Also there are some utility tools like copy, paste and trim, helps you to manage the clips. In play mode, I can tap to play a clip, or I can drag in circles to scratch the clip. If I wind the clip and drag away, it will loop the clip at the speed it was dragged.
Henry used openFrameworks to build Sound Yeah. He started off from the default audio-in and audio-out example available in the examples folder of oF. The sound is generated from the sound buffer, so its a time-based approach, he writes. In addition he also wrote some classes for the UI (which we absolutely love) as well as a DIY cable to split the microphone and headphone so he can connect to other sound source using line-in, rather than the build-in microphone. See video below of him perform with the app.
Henry hasn’t submitted Sound Yeah to Apple just yet but expects this to happen very soon.
In the meantime, you can follow the progress by following Henry on vimeo.
We will, of course, post as soon as the app is available.
UPDATE 05.08.2010 // Added 2 new videos. See below.
- SoundGyro [iPhone, openFrameworks] Latest is the series of sound apps from Henry Chu is SoundGyro, a sound toy that uses iPhone 4's gyroscope to alter pitch, octave or change the key. The app is still in development and Henry is still working on developing some advanced features. We asked Henry about SoundGyro, here is some info + inspiration behind the app. Once iPhone4 was released, I wanted to try on the gyroscope as it gives more accurate position/orientation information than the accelerometer. I had the idea to create a theremin like instrument that translate the hand position to musical notes, I did it on iPhone and Wiimote before, but the result didnt impress me, mostly because I cannot combine 2 axis of movement together, the reading will go very unstable. Another reason is that the sensor is not sensitive enough to capture small gesture, which is a big hurdle in creating expressive music, if I can only play long notes slowly. Using gyroscope I can combine 3 axis of movement together without messing up all of them. Moreover, the device can now detect the rotation rate, it adds another dimension of control. The iPad and 3Gs has a digital compass which behave in a similar way, but the sensor just got better in iPhone4. Using SoundGyro is simple, tap anywhere on the screen to start the sound, at this moment, there is no difference at where you tap, but I might add some more control for advance playing. Tilting the device upward and download to change the pitch. To move to the upper or lower octave, rotate the device, you can use up to +/- 3 octave. The rolling controls the volume. The default sound is A, in the setup page you can change the key. You can switch on/off the note snapping also that allow you to play discreet notes or slide between notes. Wonderfully, SoundGyro as you see in the video below was only one days(!) work. Henry is keen to do more so keep an eye on his vimeo account for new videos + demos. In the meantime, Sound Yeah bounced from the AppStore approval process for using a private API which Henry forgot to remove. Nevertheless, it is back in the approval queue and (hopefully) should be available in the next few […]
- Squeal [iPad, openFrameworks] In 2010, Hong Kong musician/producer/composer Gaybird Leung invited Henry Chu to create a music app for his show Digital Hug, he was inspired by SoundGyro and want to create an instrument that could respond to body gesture like a theremin. Squeal is aimed to launch with 100 faces and you are invited to take part. The team has gathered faces from designers, artists, athletes, musicians, office ladies, writers, directors.... If you are interested to become part of this app, send them your portrait and information and they will put into our queue. They cannot guarantee your face will be used but of your information will be kept securely and will only use for contact only. The app is currently in development and expected to be submitted to the AppStore in July. Henry Chu is a Hong Kong based new media artist / interactive web designer. After he finished his Electronic & Electric Engineering Degree in University of Auckland, New Zealand, he came back to his birthplace Hong Kong and started his digital design career in 1998. Previously: Squiggle [iPad, openFrameworks] - Draw lines, and play them as ... SoundGyro [iPhone, openFrameworks] - Sound by gyroscope /by ... Sound Yeah [iPad, Sound, openFrameworks] - Tap to play, drag […]
- Reactable Mobile [iPhone, iPad, Sound] The reactable got it it's start before the iPhone and iPad brought multitouch to the masses. It began as an experiment into new forms of computer interaction, both for music applications and multi-user, multi-touch applications in general. The first iteration of the Reactable was an installation that featured tangible blocks representing different sound modules that could be placed on a semi-transparent table. A camera system picked up the locations of the blocks, thanks to visual tags on the bottoms. Computer software and a video projection system then created an augumented environment for playing with these building blocks of sound. It's influence shouldn't be underestimated, as it lead to things like Microsoft's surface, Microsoft Kinect, Sony's Playstation Move and more. It also gained some mainstream notoriety when Björk used it on stage. Now, similar software is available to the common iPhone-or-iPad-owning man. Gone are the cool acrylic blocks, but they are replaced with more convenient digital versions. The interface overall looks and works very well as a multitouch app. One could fault the developers for lacking labels or clear explanations about what is going on, but this is, after all, meant as a playground where people can experiment with sound - not a serious production tool. Too much explanation would take the fun out of simply experimenting with it (and ruin the interface minimalism). Art and graphics seem to be sufficiently hi-res that they still look great even when zoomed in. Everwhere you look things are pulsating, control events are flying between modules and waveforms are flowing. It's hard to deny the visual appeal. Sequencing follows the easy 'grid' approach employed by so many applications these days and has the ability to turn off rows or columns which is a nice touch. Effects settings can be modified using a simple XY pad. It's clear that the developers understand that touch applications need to be kept simple and intuitive. The modules themselves offer a mix of synthesis, sample playback and audio effects which should allow for a good amount of creativity in your own set ups. Also, you can load your own sounds. Reactable Mobile is not totally without issues - the app crashed almost every time I clicked the 'table' menu button. Also, some elements can be a bit hard to tap when not fully zoomed in - such as the volume slider. It's also hard to rotate modules. I would suggest a larger 'hit area' for these. Hopefully the developers can get these issues fixed soon, because otherwise it is a promising and fun app. Platform: iPhone/iPad (Universal) Version: 1.0 Cost: $9.99 Developer: Reactable See […]
- ShapeSeq [iPhone, Sound] ShapeSeq is a wonderfully simple sound sequencer created by Paul Apfrod using openFrameworks. Primitive shapes represent four oscillators you can choose from. As each shape is moved around the screen, the pitch and volume moves with it. Every shape has it's own loop, and every movement is recorded on the loop for instant playback. As the loop can be varied by size and number of steps while it is playing. Features - four oscillators - easy to play - instantly resize each loop - change the numbers of steps in each loop - start composing straight away! If you like this, see also SynthPond (created using openFrameworks). Platform: iPhone Version: 1.0 Cost: […]
- Gliss [iPhone, Sound] Gliss is new sound toy application which lets you play sound files and mix them easily by drawing on your iPhone. Play your mix using a tempo or scrub through by tilting your iPhone. Gliss allows you to improvise and perform using the iPhone as a controller and an interface. Put sound under your fingertips with 5 different colors to draw your own notes, sequences and sounds. See video below for demo and although not the best composition I could come up with, you can imagine the fun and sheer extent of possibilities. Very impressive you'll agree but with precedents. Features: - 5 colors to draw different sounds / samples / voices - sample upload via wifi - sample playback in different pitches using various scales - physical tilt-controlled playhead, which adapts movements of the hand - physical randomization option: control random pitches with the phone's tilt - muting voices - glissandi over several octaves - free or grid enabled placement of notes - drifting selections - saving / opening of projects Platform: iPhone Version: 1.0 Cost: […]
- www [iPhone, iPad, Sound] www is the latest iPhone application by Kazuyuki Okamoto (OKAHON), the name behind NNN Mono, Powon and iOSC, experimental sound applications for the iOS platforms. www is a new step, creating an abstract sound toy using strings/waves analogy as a core method to generate sound soon available for both iPhone and iPad. What makes "www" musical instrument unique is the extent of functionality hidden behind what may at first appear as a simple guitar like instrument. When you start the app, you will find three strings on the screen which you can straight away play with. At the bottom left corner you will find a very small "+" sign opening a whole set of new options. The first layer includes record, play, stop, repeat. The next "+" sign that you will see as one of the options that has just appeared you can swtich on/off any of the strings. Longer tap on any of the on/off buttons will bring additional settings for that wave, allowing you to change mass, ConstK, Drag, Attack force, Tention, Play Mode, Accel Force, Accel pan value, Portamento value and Wave Control Point Display toggle. Tapping on the bars at the top of the screen will allow you to switch to Pitch transpose pad or draw bars where you can adjust Adjust the amplitude of each harmonic. Further down you have a number of other options including ability to frequency of tempo modulation, depth of tempo modulation, change colours of the UI, and finally access to sequencer which is also available. The app has just been submitted to the AppStore and should be available soon for $1.99. See video below. For more information, see okahon.com Platform: iPad/iPhone (Universal) Version: 1.0 Cost: $1.99 Developer: Okahon Previously: NNN Mono and Powon [iPhone]: Two experimental sound apps from the ... iOSC [iPhone]: OSC Controller for your […]
- Screen Capture to Sound – by Satoru Higa Created using openFrameworks, this little app Satoru Higa uses screen capture as a music sequencer. Each time app is ran, the transparent window uses the desktop as the source for […]
- Forester [Mac, Windows] Forester is a sound/composition generatorÂ visualizedÂ using TreeÂ analogy.Â Built using MaxMSP, Forester allows you to load a number of samples and navigate them as you would a forest to create sound composition. You start by selecting your samples/sounds, loading them into the app and then selecting tree size and distribution method. As you navigate the 'forest' sounds attributed to trees respond, sequenced and looped. You also have a choice to "wonder", making your cursor slightly disturbed generating sounds by its vibrations. The app also allows you toÂ change reverb settings as well asÂ save your creations. Please remember to turn your amp/mixer down low when you start using Forester. Sounds may not appear for some time so please don't keep turning up! Video below is using sample sounds available as a part ofÂ MaxMSPÂ install. Â Enjoy. Platform: Mac, Windows Cost: FREE Developer:Â leafcutterjohn Download [xrr […]
Posted on: 15/07/2010
- Senior Digital Designer at CLEVER°FRANKE
- Interaction Designer at Carlo Ratti Associati
- Creative Technologist at Deeplocal
- HTML / CSS Developer at Resn
- Climate Service Data Visualiser at FutureEverything
- Web Developer at &Associates
- Creative Technologist at Rewind FX
- Coder to collaborate with Agnes Chavez
- Data Scientist at Seed Scientific
- Data Engineer at Seed Scientific
- Design Technologist at Seed Scientific
- Creative Technologist, The ZOO at Google