Music video for Catalina, a track off the Chocolat EP by Moullinex, released in January on Gomma Records created using Kinect + Processing + Cinema 4D + After Effects.
We started with the Kinect interface library developed for Processing and made available by Daniel Shiffman. Some modifications were introduced, to get our 3D data into Cinema 4D. Each file represents one frame with a coordinate map (point index, x, y, z lines) in plaintext. A threshold filter was added to enable us to filter out any points that were too far. This way we could remove the living room entirely from the sequence. Importing files manually into Cinema 4D would be painful/impossible, so we wrote a little python script that read these files in real-time, allowing us to tweak playback speed, resolution, etc. After importing all our scenes into Cinema 4D, the rendered sequences were taken into After Effects and Premiere. Business as usual from here on.
Detailed walkthrough is available here including Cinema 4D files download and Processing code.