Beyond

What would it be like to reach into a screen and manipulate virtual objects as in real world. BEYOND is, a novel collapsible input device for direct 3D manipulation. When pressed against a screen, Beyond collapses in the physical world and extends into the digital space of the screen, such that users can have an illusion that they are inserting the tool into the virtual space. Beyond allows users to directly interact with 3D media, avoiding inconsistencies of input and output. Users can select, draw, and sculpt in 3D virtual space and seamlessly transition between 2D and 3D manipulation.

I developed two versions of Beyond prototypes with different sensing mechanisms - one with Vicon IR Camera trackers and another with the combination of wacom tablet and gyro sensor. Perspective-corrected 3D scenes are rendered with motion parallax such that users can feel the realistic illusion of 3D.