As new technologies are beginning to allow more direct interaction, just what ‘handedness’ might enable, and how it might be supported is far from clear. Simply allowing touch does not equate to making digital content tangible; making things tangible does not make them suited for all kinds of interaction. This theme is seeking to explore and develop what hands-on computing might mean, where new technologies and techniques that exploit the expressiveness of at 'handedness'
Collaborative Slate (C-Slate)
With C-Slate we are exploring how direct input horizontal surfaces can be used for remote collaboration. We have developed new stereo vision techniques for enabling touch input on a large pen-based tablet display, with the ability to recognise everyday physical objects placed on the surface. This enables users to interact with the display very naturally using stylus, hands and tangible objects. We are also developing virtual embodiments of users to enrich the remote collaboration.
Primary Contact: Shahram Izadi and Andrew Blake
People: Andrew Blake, Bill Buxton, Antonio Criminisi, Andrew Fitzgibbon, Dave Kirk, Shahram Izadi, Abigail Sellen, John Winn
- Izadi, S., Agarwal, A., Criminisi, A., Winn, J., Blake, A., Fitzgibbon. A. 2007. C-Slate: A Multi-Touch and Object Recognition System for Remote Collaboration using Horizontal Surfaces. In IEEE Conference on Horizontal Interactive Human-Computer Systems (Rhode Island, USA, October 2007). Tabletop 2007.
- Agarwal, A., Izadi, S., Chandraker, M., Blake. A. 2007, High Precision Multi-touch Sensing on Surfaces using Overhead Cameras. In IEEE Conference on Horizontal Interactive Human-Computer Systems (Rhode Island, USA, October 2007). Tabletop 2007.
The “family archive” is an interactive tabletop surface, expressly designed for the home, through which family members can capture, upload, view, organize and store their physical and digital family memorabilia. The system is being informed from studies of the home investigating current practices around home archiving, and also encompasses a number of new design methods.
Primary Contact: Abigail Sellen
People: Richard Banks, Alex Butler, Gilbert Cockton, David Kirk, Otmar Hilliges, Shahram Izadi, Abigail Sellen, Stuart Taylor
Flutter is a “living photo frame” – designed not to navigate or browse photo collections, but to create an enjoyable activity from a collection of images. Tangible interactions with a UMPC are used to bind the user closely to the system. Every interaction is logged and used to gradually evolve the structure of photo collections.
Primary Contact: Lorna Brown
People: Lorna Brown
- Williamson, J. and Brown, L.M. "Flutter: Directed Random Browsing of Photo Collections with a Tangible Interface", to appear in Proceedings of DIS 2008 (Capetown, South Africa), ACM Press.
We are exploring physics-enabled interaction techniques for multi-touch and object sensing tabletops, allowing more natural and fluid interactions with digital content.
Primary Contact: Otmar Hilliges
People: Otmar Hilliges and Shahram Izadi
This project explores the use of audio and haptics for interpersonal communication via mobile devices. The Shake2Talk system allows users to construct audio-tactile messages through simple gesture interactions, and send these messages to other people. Such messages could be used to communicate a range of meanings, from the practical to the emotional.
Primary Contact: Lorna Brown
People: Lorna Brown, Richard Harper and Abigail Sellen
- Brown, L.M. and Williamson, J., "Shake-to-talk: Multimodal Messaging for Interpersonal Communication",In Proceedings of the 2nd International Workshop on Haptic and Audio Interaction Design (Seoul, Korea), 2007, Springer LNCS.
SideSight expands the multi-touch capabilities of small mobile devices beyond the screen. Infrared sensors embedded along each side of device are capable of detecting the presence and position of fingers within the proximity of the device. When the device is rested on a flat surface, such as a table, the user can carry out single and multi-touch gestures using the space around the device. This gives a larger input space than would otherwise be possible, and which may be used in conjunction with, or instead of, on-display touch input.
Alex Butler, Shahram Izadi, Steve Hodges
“SideSight: multi-'touch' interaction around small devices”
In Proceedings of the 21st Annual ACM Symposium on User interface Software and Technology (Monterey, CA, USA, October 19 - 22, 2008). UIST '08. ACM, New York, NY, 201-204.
Gizmodo, “Microsoft SideSight Thinks Touchscreens Have It Wrong”
New Scientist, “Virtual touchpad lets you scroll in thin air”
Microsoft's SideSight: Something Apple Should Watch
Microsoft SideSight makes for multi-touch off the screen
This project explores a new technique for optical sensing through thin form-factor displays. It allows for detection of fingers and other physical objects close to or on the display surface. This essentially allows us to turn a regular LCD into a sensing surface that can be used for multi-touch and tangible computing applications. We are interested in both the underlying hardware and software aspects of this approach as well as the interaction techniques and application scenarios it enables.
Primary Contact: Shahram Izadi and Steve Hodges
People: Alex Butler, Bill Buxton, Steve Hodges, Shahram Izadi, Mike Molloy, Alban Rrustemi, Stuart Taylor, Darren West
- Izadi, S., Hodges, S., Butler, A., Rrustemi, A., and Buxton, B. 2007. ThinSight: integrated optical multi-touch sensing through thin form-factor displays. In Proceedings of the 2007 Workshop on Emerging Displays Technologies: Images and Beyond: the Future of Displays and interacton (San Diego, California, August 04 - 04, 2007). EDT '07, vol. 252. ACM Press, New York, NY, 6. DOI= http://doi.acm.org/10.1145/1278240.1278246
- Hodges, S., Izadi, S., Butler, A., Rrustemi, A., and Buxton, B. 2007. ThinSight: versatile multi-touch sensing for thin form-factor displays. In Proceedings of the 20th Annual ACM Symposium on User interface Software and Technology (Newport, Rhode Island, USA, October 07 - 10, 2007). UIST '07. ACM Press, New York, NY, 259-268. DOI= http://doi.acm.org/10.1145/1294211.1294258 (Best paper award)