Arduino, openFrameworks, Processing
comment 1

The Space Beyond Me [openFrameworks, Arduino, Processing]

apparatus copy

The Arriflex 16 ST body with UV-light source and motorized zoom lens

Julius von Bismarck and Andreas Schmelas have just open sourced the code of their collaboration project “The Space beyond me”. The project includes an “Apparatus for reviving spaces that are captured in celluloid” and was exhibited at the Transmediale 2010 (Berlin) and several other festivals (right now it can be seen at the Ghent Film Festival in Belgium). The installation is able to construct a representation from celluloid film combining a modified 16mm camera with a UV-light projector. The device projects a film whilst moving in exactly the same way in which the camera operator moved the camera while shooting the film.

What happens, if a projector moves while it is projecting in exactly the same way in which the camera moved that recorded the film, which is now being projected? What happens, is similar to processes happening in the brain when we perceive our surroundings. Virtual rooms or landscapes are composed from flat visual information, constructing a subjective representation of the world.

The projector is placed centrally in a round room, the walls of which are painted with phosphorescent paint. The paint emits an afterglow of the image projected onto it, so that the moving camera-projector keeps adding to the image. After the film has played, all scenes of the film are reproduced in their correct location. The film, which originally recorded a spatial setting, has been translated from a time-based medium back into a space.

The software for the installation (available to download here) consists of several parts and including a openframeworks scene arrangement application, arduino sourcecode and a processing app (responsible for parsing the output of the openframeworks into a arduino compatible progmem format array). The openframeworks part includes an application for extracting “camera movement” out of a video and an application for arranging “scenes” onto a virtual stage.

Project pages

The Space Beyond Me from fenomenologie on Vimeo.

»The Space Beyond Me« still, Transmediale 2010

Various drafts by Julius


  • Internet Machine – Invisible infrastructures of the internetInternet Machine – Invisible infrastructures of the internet Produced by Timo Arnall, Internet Machine is a multi-screen film about the invisible infrastructures of the internet. The film was made to reveal hidden materiality of our data by exploring some of the machines through which ‘the cloud’ is transmitted and […]
  • Link [openFrameworks, iPad, Flash, vvvv]Link [openFrameworks, iPad, Flash, vvvv] Building on their previous installation at Coffee Kitchen, Kimchi and Chips created 'Link', their latest interactive installation for  Design Korea 2010 where people record their stories into a cityscape of cardboard boxes. Link was created for the event as an interpretation of 'Convergence', the theme of the exhibition. The team presented a convergence of complex, fast moving technologies with low, everyday materials. Furthermore, the audience is invited to take part and "can store their memories inside boxes". The installation includes a number of different components. To match the projections to the boxes, the team developed iPad mapping application allowing users to interactively match projected images in the room. App was built using openFrameworks and libmysql (see video demo at the bottom of the post). The iPad interface, allowing users to add information was also built using built using openFrameworks with 2-way communication over OSC. Main mapping playback was created using VVVV with custom plugins for threaded video playback / recording (up to 80 videos playing simultaneously whilst 2 videos being recorded), MySQL for database and a total of around 3000 recordings were taken during the exhibition. The team also used Adobe Flash for designing animations. Hardware included 3 servers, each Core i7 Quad core (8 threads), Nvidia Geforce 460 GTX, 8GB RAM (for caching video playback), Triplehead2Go x 2, 2xPlaystation eye and 6 x 3000lm projector. See video below including the making of at the bottom of the post. Project Page Kimchi and Chips are a cross-disciplinary art & design studio based in London and Seoul. They create installations, products and services that bridge the gap between people and people, people and technology, people and nature. They are Elliot Woods, media artist, technical designer and Mimi Son, user-centred interaction designer and visual […]
  • Macrofilm – A Tangible Narrative Ribbon by panGeneratorMacrofilm – A Tangible Narrative Ribbon by panGenerator Created by the panGenerator collective, Macrofilm is a permanent interactive installation for The Museum of The History of Polish Jews that combines traditional, tangible experience of browsing through old archives with subtly augmented digital […]
  • Moving Picture Show by Jürg Lehni and ContributorsMoving Picture Show by Jürg Lehni and Contributors Created Jürg Lehni, Moving Picture Show is an installation presented during the 23rd International Poster and Graphic Design Festival in Chaumont where the Jesuit chapel was transformed into a workshop, a scenario of conception, production and a projection space. The installation deals with the current migration from analogue to digital film projection in cinemas across the globe by reappropriating a 35mm motion picture film using high-powered precision laser. In Moving Picture Show, a scenario of animated drawing and text is created by applying the process normally used by the film industry to etch subtitles into the emulsion layer of 35mm film. By etching away the emulsion using a high-powered precision laser, only the clear base of the film remains and when projected onto the screen the lines appear bright and clear. Discovering this mechanism triggered the idea for a reappropriation of this principle, by extending the reach of the laser to the full size of a film frame, and changing the software to allow the drawing of any kind of shapes, based on vectorial line drawings. The idea was to build a setup for the exploration of the possibilities and aesthetics of such a production mechanism, allow a revisiting of early experimental film (Len Lye, Norman McLaren, etc.) through the lens of computer technology, while at the same time celebrating the disappearance of this beautiful medium that is 35mm film and the equipment that goes with it. Making a process visible that normally only happened behind closed industrial doors was part of the motivation too. Together with the tinkerers from in Zurich who have helped build Rita and Viktor (see also Hektor), and after looking at different ways of changing the original software and even getting in touch with the original engineer, the team finally came up with a plan: They decided to keep the original software to control the transport of the film and found a new way to send the commands to step images forward and backward. This was achieved by sending the original software virtual key-strokes on the F-keys. The original software would only function if it also had the impression that it was at the same time controlling the mirrors that steer the laser by talking to their controller, so they ended up building their own self-made controller, and wrote bespoke firmware for it that would allow them to freely control the mirror's movements at a very hight speed (the controller would send position commands at a frequency of 12.5k times a second). About a month and endless tests they were finally able to burn first images. In the end, the software that sends the drawing commands to the laser controller (written in Java) was built almost like a printer driver that would take a folder full of PDFs and burn them one by one, 24 images per second, 25'091 images for "Spirit & Letter", a 18 minute film of animated type based on Donald Knuth's METAFONT and created by David Reinfurt / Dexter Sinister for Moving Picture Show. Several contributing designers were invited to engage with the production facility and collaborate on the contents of the show, producing films that were projected repeatedly during the festival. Meanwhile the laser machine, also present in the chapel, was slowly producing new films for future screenings. Project by Jürg Lehni with contributions from James Goggin (US), Maximage (CH), Karl Nawrot (NL), Jonathan Puckey / Moniker (NL), David Reinfurt […]
  • Didier LAHELY

    I tried so hard to understand what it was about. Failed. : )