Instead of AdBlock, enjoy ad-free CAN by becoming a member. Everybody wins!

OUT NOW:
HOLO 1

Emerging trajectories in art, science, and technology.

226 pages of conversation, research, opinion, analysis. Step into artists' studios and workshops to discover the faces, personalities, and processes behind important work. Learn more!

HOLO is brought to you by the people behind CreativeApplications.Net

Hand tracking gesture experiment with iisu middleware and oF

Created by Ben McChesney at Helios Interactive, is this handtracking gesture experiment using openFrameworks and the latest release of the iisu 3.5 – gesture recognition middleware, compatible with all 3D cameras. The video shows Ben using a grasping hand to draw 3D ribbons based on the hand position or navigating the camera within 3D space.

One of the features the team are excited about is the Close Interaction Mode which allows for a more detailed API based on hand and finger tracking. Users can use a hand pose gesture to easily toggle between drawing and camera mode. Ben also believes that the long range interaction should work with a kinect. He tested the iisu middleware with the ASUS xtion, Panasonic D-Imager, and the Depthsense. He ads that the close range mode will only work with the SoftKinetic Depthsense 311 camera.

The code for the whole project and several examples are available on the company’s github : https://github.com/HeliosInteractive/ofxIisu

Examples include : User Representation , Skeleton Tracking, and Close Range Hand Tracking. These examples are written for visual studio 2010 with OF version 0071.The code for the ribbons is based off of an old flocking example by roxlu. The Ribbon source can be found on Ben’s github.

The application in the video below is running on a Samsung transparent LCD panel which displays white pixels as being transparent.

iisu | Helios Interactive