This project investigates techniques to enable interaction with 3D virtual worlds on interactive tabletops. We investigate techniques to extend the display space beyond the display using among others switchable projection screens. Another area of interest is sensing of 3D input data above 2D surfaces. Here we're presenting a number of interaction technique that enable fine-grained manipulations of virtual 3D worlds.
Interactions In the Air
This project explored several interaction techniques that allow for richer human computer interaction more akin to the flexible and continuous ways in which we manipulate objects in the real world. A model for more natural interactions with 3D data on interactive surfaces is introduced.
Because the interaction – the sensed input and the displayed output – is still bound to the surface, there is a fundamental limitation in manipulating objects using the third dimension. To address this issue, we proposed a novel approach to creating a continuous interaction space – on the surface and above the surface – conceptually allowing users to pick objects off the surface and manipulate their position in 3D as if it were a real object. We present several ways to enable “in-the-air” interactions that allow users to interact with 3D data (rendered on a 2D display) in a as-direct-as possible fashion. This approach utilizes several interesting hardware and software components such as a switchable diffuser, infrared illumination, IR-based depth estimation, holographic projection screens and a depth-sensing camera.
SecondLight is a new type of surface computer, one that opens up the interaction space above and beyond the display.
SecondLight supports multi-touch and tangible interactions like a regular Microsoft Surface, but simultaneously, our technology allows secondary content to be projected through the display, as well as sensing of user gestures and objects held above the surface.
- Otmar Hilliges, Shahram Izadi, Andrew D. Wilson, Steve Hodges, Armando Garcia-Mendoza, and Andreas Butz, Interactions in the Air: Adding Further Depth to Interactive Tabletops , in Proceedings of 22nd ACM Symposium on User Interface and Software Technologies (ACM UIST 2009), Association for Computing Machinery, Inc., October 2009.
- Shahram Izadi, Steve Hodges, Stuart Taylor, Dan Rosenfeld, Nicolas Villar, Alex Butler, and Jonathan Westhues, Going Beyond the Display: A Surface Technology with an Electronically Switchable Diffuser, in ACM Symposium on User Interface Software and Technology (UIST '08), Association for Computing Machinery, Inc., 19 October 2008.