Golan Levin was invited by the FITC conference to answer a series of “Ask Me Anything” questions posted by Reddit visitors. At the STUDIO for Creative Inquiry, Golan’s video was created by Fellows James George and Jonathan Minard, artists-in-residence researching new forms of experimental 3D cinema. Their work explores the notion of “re-photography”, in which otherwise frozen moments in time may be visualized from new points of view.
Despite the sometimes wildly moving camera, the video was in fact shot with a stationary Kinect-like depth sensor coupled to a digital SLR video camera. To compose their shots, the filmmakers developed custom openFrameworks software that aligns and combines color video and depth data into a dynamic sculptural relief. In a process of “virtual cinematography”, James and Jonathan rephotographed Golan’s 3D likeness — selecting new angles, dollying, and zooming — to compose new perspectives on the data as if playing a video game. Fixed camerawork is thus transformed into a malleable and negotiable post-process, in which shots can be carefully recomposed to highlight and inflect different latent meanings.
This experiment developed out of concepts and collaborations born at Art && Code, a conference on 3D sensing and visualization organized by Golan’s laboratory, the STUDIO for Creative Inquiry at Carnegie Mellon University. Artist-hackers assembled to explore the artistic, technical, tactical and cultural potentials of low-cost depth sensors, such as the Kinect. As an outcome of the conference, James George, a creative coder interested in cinema, and Jonathan Minard, a documentary filmmaker interested in new-media technology, are now collaborating on the development of open-source tools and techniques for augmenting high-resolution video with depth information.
Watch the interview below.
Next up for James George and Jonathan Minard with support from STUDIO for Creative Inquiry, is our own Resonate festival taking place in Belgrade in March this year. The duo will record RGB+D interviews with event speakers including Nicholas Felton, Josh Nimoy, Jer Thorp, Greg J. Smith, Regine Debatty, Champagne Valentine, Niklas Roy, Benjamin Gaulon, Karsten Schmidt, alva noto & blixa bargeld and many more..
In addition, James with Alexander Porter will also host a workshop with the title “RGB+Depth filmmaking”. The team will demonstrate the entire filmmaking workflow; attaching the cameras together, capturing data, visualizing and rendering sequences. The participants will get a hands-on experience with these tools and leave the workshop with footage, software and knowledge of how to use this exciting new cinematic format in your own films.
There is still time to register for Resonate with only a few tickets remaining. More information here.
Other workshops include “Toxiclibs – a toolbox for computational design” with Karsten Schmidt, “Electronic Instant Photo Safari” workshop with Niklas Roy, “DMX/openFrameworks Lighting” workshop with Andreas Müller , “Recycling Entertainment System” workshop with Benjamin Gaulon & Martial Geoffre-Rouland and more yet to be announced.
See also ofxTimeline — a way to visually interact with values over time..