Please disable AdBlock. CAN is an ad-supported site that takes hundreds of hours and thousands of dollars to sustain. Read More.
HOLO is a biannual magazine about emerging trajectories in art, science, and technology brought to you by the people behind CAN. Learn more!

Weather Worlds by design I/O grants children weather controlling superpowers

Theo and Emily

Theo and Emily

Weather Worlds is a new interactive installation by design I/O that grants children weather controlling superpowers. Utilising cameras and real-time greenscreening via openFrameworks, the installation allows children to see themselves immersed in an interactive and dynamic environment. The custom computer vision system tracks the heads, hands, feet and movement of children on the platform and also recognizes gestures. Using their bodies children can conjure a storm, release a twisting tornado or rain down bolts of lightning from their fingertips. There are mighty wind fields to move through, stomping earthquakes, light bending sunshine and blizzards that will make you shiver!

Weather Worlds uses an HD CCTV camera, combined with a Blackmagic UltraStudio Mini to capture 1080p video of the audience standing in front of a greenscreen. The audience is then chromakeyed in realtime by the openFrameworks based software, which extracts the contours of each person and builds a skeleton of them, allowing specific gestures to be detected. The chromakey happens in two passes once on the CPU at low res for the tracking and analysis and then separately on the GPU as a shader to allow fast compositing at 1080p.

The skeleton tracking code will be released as an openFrameworks addon and a standalone app which others will be able to use in their projects.

Weather Worlds was made possible by La Gaîté Lyrique, Paris and the TIFF Kids Digiplayspace in Toronto.
Created by Theo Watson, Emily Gobeille and Nick Hardeman

Project Page | design I/O

PastedGraphic-2PastedGraphic-1trackingweather_worlds_design_io_03weather_worlds_design_io_01weather_worlds_design_io_02weather_worlds_design_io_05weather_worlds_design_io_06weather_worlds_design_io_07weather_worlds_design_io_08weather_worlds_design_io_09weather_worlds_design_io_10

    • Evan

      Awesome stuff! Design I/O are always such a huge inspiration!

    • Jorge Avila

      Amazing! the add on is already available?

    • Jorge Avila

      Amazing! the add on is already available?