‘Extending the Touchscreen’ is an ITP Thesis project by Michael Knuepfel which includes seven devices designed to improve upon or supplement the functionality of capacitance touchscreens; game controller, digital signet rings, mechanical stylus, sound stylus, pulse generator, dial-a-rama and future devices.
Touchscreens like those found on smartphones and tablets have enabled a new generation of versatile user interfaces. My thesis project, Extending the Touchscreen, aims to further this versatility by using conductive materials to construct a series of physical, mechanical, and electrical devices that touch, interact and communicate directly through the touchscreen interface. My goal in constructing these external devices is to make touchscreen interactions more tactile, physical and potentially more expressive and fun.
Instead of utilising USB connection to extend the functionality of iPad and iPhone, the devices rely on the software, simple light senors or magnets to allow objects to communicate between each other. Some devices are just used as tools to unlock the iphone for example, others allow robot like objects to behave in a certain way by ‘reading’ information from iPad’s screen. See video for more + follow Michael’s blog for updates.
- Physical Touchscreen Knobs [iPhone, iPad] This is an experiment by DS-Labs (a bunch of designers at Teague), same collective that brought you DIY Soft iPhone and iPad Stylus. What I find especially interesting is that although quite limited, this little experiment actually provides a very good insight of what is yet to come. Whilst touch screen tables such as Microsoft Surface or many more incorporate camera so are able to recognise objects that are located on the surface (reacTIVision), iPhone and iPad do not have a camera so they purely rely on a touch input. This experiment demos physical knob used instead of a finger which suggests interesting possibilities for how application may behave or be designed for the platforms. Although this is a simple rotary input interface demoed to rotate a map. Combining this with some smart software it could get very interesting. I think a lot of people fail to acknowledge that the future are NOT touch screen devices but those that combine both the physical and touch input, thus 'Physical Touchscreen Knobs' gets 10 points from me. See video below. Alternatively, with a small knob, it’s natural to grab it such that your fingers actually touch the screen making it nothing more than a physical prop to provide some tactile feedback. It works great and doesn’t require much in terms of materials or time; just grab a small object and give it a try! […]
- Touch Vision Interface [openFrameworks, Arduino, Android] Created by Teehan+Lax Labs, Touch Vision Interface is a combination of software and hardware to allow realtime manipulation of content on a remote device via touch interface on a mobile device. Instead of purely using mobile device screen as an input, the user views the remote content and applies the content simultaneously, better know but not necessarily a form of AR. I can still recall the first time I saw an Augmented Reality demo. There was a sense of wonderment from the illusion of 3D models living within the video feed. Of course, the real magic was the fact that the application was not only viewing its surrounding environment, but also understanding it. AR has proven to be an incredible tool for enhancing perception of the real world. Despite this, I’ve always felt that the technology was somewhat limited in its application. It is typically implemented as output in the form of visual overlays or filters. But could it also be used for user input? We decided to explore that question by pairing the principles of AR (like real-time marker detection and tracking) with a natural user interface (specifically, touch on a mobile phone) to create an entirely new interactive experience. The translation of touch input coordinates to the captured video feed creates the illusion of being able to directly manipulate a distant surface. Peter imagines future applications of this technology both in the living room or in large open spaces. Brands could crowd-source easier with billboard polls, group participation on large installations could feel more natural. Likewise other applications could include music creation experience where each screen becomes an instrument. The possibilities become even more exciting when considering the most compelling aspect of the tool – the ability to interact with multiple surfaces without interruption. No need to switch devices through a secondary UI – simply touch your target. You could imagine a wall of digital billboards that users seamlessly paint across with a single gesture. Created using opencv-android, openframeworks and python/arduino for the led matrix. Touch Vision Interface (Thanks […]
- The Well–Sequenced Synthesizer by Luisa Pereira The Well–Sequenced Synthesizer is a series of sequencers created by Luisa Pereira at ITP -- physical interfaces to play with musical […]
- knot(e) by Matthieu Minguet – Sound and visual interface for iPhone (ECAL) Created by Matthieu Minguet, knot (e) is a custom built device that offers a new way of using objects that we connect to our mobile devices. The prototypes, shown in the form ropes, harness themselves to revisit the new node as input data. As an extension of a conventional listening device, it allows the user to generate visual and sound compositions by the simple action of "bending the cable". The intersection of the rope amplifies the signal. Conversely, the absence of knots and curves restores the application to its original position. Each prototype has its own forms, colours, atmospheres and sound effects. They are polyester sheet halyards from wich the core has been replaced with an empty silicon tube. They are attached with two wood cylinder and custom plugs with rubber rings to the extremities. Each plug are prepared to receive specific electronic components and are easily detachable. They can be connected to one another for more complex compositions or used one at the time. A series of Five Flex Sensors attached along the tube are connected to a femtoduino board. The board communicate with the iphone trough a softModem by hiJack the audio jack. The audio Circuit is separate in two ports. The first go directly to a 3.5mm audio female jack and the second (Microphone) allows iPhone communication. Everything is connected to a 240 Mah polymer battery, a switch and a power supply. Software is managed by openFrameworks, IOS Objective-C and PureData. The openFrameworks part for conceptualize the application. The objective-C for the GUI and the audio softModem analysis. Finally, PureData for playing audio loops, generate effects and return audio flux informations. This system might work also with the personal iPod library class, which Matthieu says was not an interesting option to explore. The main technical challenge for Matthieu was to manage the size of components in a tiny cylinder volume. Components and wire management. And also to communicate with those three languages. The physical interaction of bending the rope could also be mapped to other applications for altogether different purpose. Software: openFrameworks / Objective-C / Pure Data Hardware: Arduino / Sensors / sailing Rope / iPhone cargocollective.com/matthieuminguet Tutor: Alain Bellet, Gael Hugo, Christophe Guignard ECAL / University of Art and Design, Lausanne Switzerland Bachelor Media & Interaction […]
- Soundrop [iPhone, iPad, Sound] Soundrop is a sound toy application for iPad, iPhone & iPod Touch which allows you to create sounds by drawing lines on the screen and have ball bouncing off them. Each time the ball touches the line, a sound is generated. Depending on the location of the line on the screen, the tone of the sound is set. You can move the ball emitter, changing the nature of the composition. You can modify the location of lines by dragging points that define them alternatively double tap on any line will clear it. Wonderfully simple and a lot of fun to play with. Check it out..it's free. Platform: iPhone Version: 1.0 Cost: Free Developer: Develoe […]
- Thicket [iPad, iPhone] Featured in our "Must have iPad Apps" but never got a post of it's own, Thicket is now version 2 and with that it's own feature on CAN. In case you missed it, Thicket is an audiovisual app created by Joshue Ott and Morgan Packard. It is also a world of texture, movement, line and tone. Thicket is part toy, part wind chime, part spiderweb. The app is now also on sale for $0.99 - to celebrate the new release (normal price $2.99). If you like snowflakes, chaos, fire, and music without words, there's a good chance you'll love Thicket. It's wonderful + visual joy guaranteed! What's new in ver 2: -completely new mode system: simply tilt your device to change modes. -two brand new modes. -5 different modes total! -added more information to the info screen -new ultra smooth VGA out mode (non-mirrored) Also, Thicket is a side project of intervalstudios, a collective Joshue Ott and Morgan Packard. Joshue's also known for his SuperDraw app, while Morgan composes and performs with his own SuperCollider application called Ripple. You can hear his music here. (edit 09/11/2010) In case you are interested how to get the video out in your app, Peter has a nice post about both the Thicket and Video-Out on the iPad. Platform: iPhone/iPad (Universal) Version: 2.0 Cost: $2.99 Developer: […]
- Longhand Publishers – Design workstations for collaborative mini publications In the former building of the Newspaper BN De Stem, the installation created by Tim Knapen & indianen, allows visitors to collaboratively create mini […]
- Konkreet Performer [iPhone, iPad, Sound] Very first glance at Konkreet Performer iPhone/iPad app by Konkreet Labs, visual OSC controller and visualizer for your DAW / Synth / Drum Machine / Sampler etc. Konkreet Performer is a control instrument for live music performance. Its unique and intuitive multi-touch interface reconnects the musician’s actions directly with the music. Taking full advantage of the possibilities created by the latest multi-touch technology, Konkreet Performer delivers a revolutionary new way to control your DAWs, synthesizers, samplers (anything that receives MIDI/OSC). More than a studio controller, Konkreet Performer has been designed from the ground up to be a superior live performance instrument, bringing the dynamic audio and visual connection between the musician and the audience to the stage. It will be released as an iOS App at the beginning of 2011. Coming soon for iPad / iPhone / iPod Touch konkreetlabs.com/ (Thanks […]
Posted on: 11/05/2011
- Senior Digital Designer at CLEVER°FRANKE
- Interaction Designer at Carlo Ratti Associati
- Creative Technologist at Deeplocal
- HTML / CSS Developer at Resn
- Climate Service Data Visualiser at FutureEverything
- Web Developer at &Associates
- Creative Technologist at Rewind FX
- Coder to collaborate with Agnes Chavez
- Data Scientist at Seed Scientific
- Data Engineer at Seed Scientific
- Design Technologist at Seed Scientific
- Creative Technologist, The ZOO at Google