WorldKit aims to transform any surface to an interactive computer interface. Robert Xiao, lead researcher on the project, tells us: “We allow a user to basically select a surface on which they can ‘paint’ an interactive object, like a button or sensor”.
Fox News explains: “WorldKit works by pairing a depth-sensing camera lens, such as the one that the Kinect uses, with a projector lens. Then, programmers write short scripts on a MacBook Pro using Java, similar to those they might write for an Arduino, to tell the depth camera how to react when someone makes certain gestures in front of it. The depth camera interprets the gestures and then tells the projector to react by projecting certain interfaces. For instance, if someone makes a circular gesture, the system can interpret that by projecting a dial where the gesture was made. Then, when someone “adjusts” the dial by gesturing in front of it, the system can adjust a volume control elsewhere.”