A few MIT students have created a cool device that lets users draw and manipulate 3D objects in real time on an iPad screen. They can then put on a motion-tracked glove and move things around by placing their hand behind the iPad and moving it around.
The project is called T(ether). The glove is used to manipulate objects thanks to the small sensors it has on the fingertips. It’s something like motion capture technology used in movies, it seems, as is explained to website Cult of Mac by one of the researchers behind it:
David Lakatos, one of the researchers involved with the T(ether) project, responded to our email asking about the system. He says, “The iPad is running an app compiled with the Cinder library, which is a C++ wrapper for openGL. We are not using the camera on the iPad – we use a Vicon motion-capture system (used in the film industry) to track the iPads location and orientation. The attached rectangle is what the motion-capture system tracks. By constantly tracking the 5 retroreflective dots on it, we can reconstruct the correct pose (position + orientation) of the iPad. We track the gloves with the same system.”