Andy Wilson
![]() |
I am a principal researcher at Microsoft Research. My work is focused on applying sensing techniques to enable new styles of human-computer interaction. Today that means multi-touch and gesture-based interfaces, display technologies, depth cameras and so-called "natural" interfaces. In 2002 I helped found the Surface Computing group at Microsoft. I manage the Natural Interaction Research group at Microsoft Research. Before joining Microsoft, I obtained my BA at Cornell University, and MS and PhD at the MIT Media Laboratory. I grew up in a small town in Pennsylvania and now live in the Wallingford neighborhood of Seattle.
I use this page primarily to list my academic publications. It
was last edited on
May 28, 2013. My business card has my contact info. I gave a talk on my research at the BUILD conference in 2012. You can watch it here. New! Check out my YouTube channel! |
|
Professional Activities |
|
|
I've been active in the UIST, CHI, Tabletop (now Interactive Tabletops and Surfaces), ICMI, and Ubicomp academic communities, where I've have had the pleasure of serving on various program committees. I co-chaired Tabletop 2007 and chaired UIST 2009. I tend to publish under the name "Andrew D. Wilson". |
|
|
Conference Papers |
|
| Willis, K., and Wilson, A. InfraStructs: Fabricating Information Inside Physical Objects for Imaging in the Terahertz Region. Siggraph 2013 (to appear). | |
![]() |
Jones, B., Benko, H., Ofek, E., and Wilson, A. IllumiRoom: Peripheral Projected Illusions for Interactive Experiences. CHI 2013. Best Paper Award. |
![]() |
Wilson, A., Benko, H., Izadi, S., and Hilliges, O. Steerable Augmented Reality with the Beamatron. UIST 2012. |
![]() |
Benko, H., Jota, R., and Wilson, A. MirageTable: Freehand Interaction on a Projected Augmented Reality Tabletop. CHI 2012. |
|
Sodhi, R., Benko, H., and Wilson, A. LightGuide: Projected Visualizations for Hand Movement Guidance. CHI 2012. |
|
Rofouei, M., Wilson, A., Brush, A.J., and Tansley, S. Your Phone or Mine?: Fusing Body, Touch, and Device Sensing for Multi-User Device-Display Interaction. CHI 2012. |
|
Schwarz, J., Kilonsky, D., Harrison, C., Dietz, P., and Wilson, A. Phone as a Pixel: Enabling Ad-hoc, Large-Scale Displays Using Mobile Devices. CHI 2012. |
|
Hilliges, O., Kim, D., Izadi, S., Weiss, M., and Wilson, A. HoloDesk: Direct 3d Interactions with a Situated See-Through Display. CHI 2012. |
|
Harrison, C., Benko, H., and Wilson, A. OmniTouch: Wearable Multitouch Interaction Everywhere. UIST 2011. |
|
Holz, C. and Wilson, A. Data Miming: Inferring Spatial Object Descriptions from Human Gesture. CHI 2011. |
![]() |
Benko, H. and Wilson, A. Multi-Point Interactions with Immersive Omnidirectional Visualizations in a Dome. Interactive Tabletops and Surfaces 2010. |
![]() |
Wilson, A. Using a Depth Camera as a Touch Sensor. Interactive Tabletops and Surfaces 2010. |
![]() |
Wilson, A., and Benko, H. Combining Multiple Depth Cameras and Projectors for Interactions On, Above and Between Surfaces. UIST 2010. |
![]() |
Hinckley, K., Yatani, K., Pahud, M., Coddington, N., Rodenhouse, J., Wilson, A., Benko, H., and Buxton, B. Pen + Touch = New Tools. UIST 2010. |
|
Schwarz, J., Hudson, S., Mankoff, J. and Wilson, A. A Framework for Robust and Flexible Handling of Inputs with Uncertainty. UIST 2010. |
![]() |
Morris, M. R., Wobbrock, J. O., and Wilson, A.D.
Understanding
Users’ Preferences for Surface Gestures.
Graphics Interface 2010. |
![]() |
Benko, H., Izadi, S., Wilson, A. D., Cao, X., Rosenfeld, D., and Hinckley, K. Design and Evaluation of Interaction Models for Multi-touch Mice. Graphics Interface 2010.
|
![]() |
Hinckley, K., Yatani, K., Pahud, M., Coddington, N., Rodenhouse, J., Wilson, A., Benko, H., and Buxton, B. Manual Deskterity: An Exploration of Simultaneous Pen + Touch Direct Input. ACM CHI 2010 Extended Abstracts (alt.chi). |
![]() |
Hartmann, B., Morris, M. R., Benko, H., and Wilson, A. Pictionaire: Supporting Collaborative Design Work by Integrating Physical and Digital Artifacts, CSCW 2010. |
![]() |
Wilson, A. Simulating Grasping Behavior on an Imaging Interactive Surface, Interactive Tabletops and Surfaces 2009. |
![]() |
Hilliges, O., Izadi, S., Wilson, A., Hodges, S., Garcia-Mendoza, A., and Butz, A. Interactions in the Air: Adding Further Depth to Interactive Tabletops, UIST 2009. |
![]() |
Hartmann, B., Morris, M. R., Benko, H., and Wilson, A. Augmenting Interactive Tables with Mice and Keyboards, UIST 2009. |
![]() |
Nacenta, M., Baudisch, P., Benko, H., and Wilson, A. Separability of Spatial Manipulations in Multi-touch Interfaces, Graphics Interface 2009. |
![]() |
Wobbrock, J. O., Morris, M. R., and Wilson, A. User-Defined Gestures for Surface Computing, CHI 2009. |
![]() |
Wilson, A., Izadi, S., Hilliges, O., Garcia-Mendoza, A., and Kirk, D. Bringing Physics to the Surface, UIST 2009. Best Paper Award. |
![]() |
Benko, H., Wilson, A. and Balakrishnan, R. Sphere: Multi-touch Interactions on a Spherical Display, UIST 2008. |
![]() |
Everitt, K., Morris, M. R., Brush, A., and Wilson, A. DocuDesk: An Interactive Surface for Creating and Rehydrating Many-to-Many Linkages among Paper and Digital Documents, Tabletop 2008. |
![]() |
Cao, X., Wilson, A., Balakrishnan, R., Hinckley, K., and Hudson, S. ShapeTouch: Leveraging Contact Shape on Interactive Surfaces, Tabletop 2008. |
![]() |
Olwal, A., and Wilson, A. SurfaceFusion: Unobtrusive Tracking of Everyday Objects in Tangible User Interfaces, Graphics Interface 2008. |
![]() |
Wilson, A. Depth-Sensing Video Cameras for 3D Tangible Tabletop Interaction, Tabletop 2007. |
![]() |
Wobbrock, J. O., Wilson, A., and Li, Y. Gestures without Libraries, Toolkits or Training: A $1 Recognizer for User Interface Prototypes, UIST 2007. |
![]() |
Wilson, A. and Sarin, R. BlueTable: Connecting Wireless Mobile Devices on Interactive Surfaces Using Vision-Based Handshaking, Graphics Interface 2007. |
![]() |
Baudisch, P., Sinclair, M., and Wilson, A. Soap: A Pointing Device that Works in Mid-Air, UIST 2006. |
![]() |
Wilson, A. Robust Vision-Based Detection of Pinching for One and Two-Handed Input, UIST 2006. |
![]() |
Benko, H., Wilson, A., and Baudisch, P. Precise Selection Techniques for Multi-Touch Screens, CHI 2006. |
![]() |
Wilson, A., and Agrawala, M. Text Entry Using a Dual Joystick Game Controller, CHI 2006. |
![]() |
Wilson, A. PlayAnywhere: A Compact Tabletop Computer Vision System, UIST 2005. |
![]() |
Wilson, A., and Cutrell, E. FlowMouse: A Computer Vision-Based Pointing and Gesture Input Device, Interact 2005. |
![]() |
Wilson, A. TouchLight: An Imaging Touch Screen and Display for Gesture-Based Interaction, International Conference on Multimodal Interfaces 2004. |
![]() |
Paek, T., Agrawala, M., Basu, S., Drucker, S., Kristjansson, T., Logan, R., Toyama, K., and Wilson, A. Toward Universal Mobile Interaction for Shared Displays, CSCW 2004. |
![]() |
Wilson, A., and Oliver, N. GWindows: Robust Stereo Vision for Gesture-Based Control of Windows, International Conference on Multimodal Interfaces 2003. |
![]() |
Wilson, A., and Pham, H. Pointing in Intelligent Environments with the WorldCursor, Interact 2003. |
![]() |
Wilson, A., and Shafer, S. XWand: UI for Intelligent Spaces, CHI 2003. |
|
Wilson, A., and Bobick, A. Realtime Online Adaptive Gesture Recognition, International Conference on Pattern Recognition, 2000. |
|
![]() |
Johnson, M., Wilson, A., Kline, C., Blumberg, B. and Bobick, A. Sympathetic Interfaces: Using a Plush Toy to Direct Synthetic Characters, CHI 1999. |
|
Wilson, A., and Bobick, A. Nonlinear PHMMs for the Interpretation of Parameterized Gesture, Computer Vision and Pattern Recognition, 1998. |
|
|
Wilson, A., and Bobick, A. Recognition and Interpretation of Parametric Gesture, International Conference on Computer Vision, 1998. |
|
|
Wilson, A., Bobick, A., and Cassell, J. Recovering the Temporal Structure of Natural Gesture, Second International Conference on Automatic Face and Gesture Recognition, 1996. |
|
|
Wilson, A., Cassell, J., and Bobick, A. Temporal Classification of Natural Gesture and Application to Video Coding, Computer Vision and Pattern Recognition, 1997. |
|
|
Wilson, A., and Bobick, A. Learning Visual Behavior for Gesture Analysis, IEEE International Symposium on Computer Vision, 1995. |
|
|
Bobick, A., and Wilson, A. A State-Based Technique for the Summarization and Recognition of Gesture, International Conference on Computer Vision, 1995. |
|
|
Wilson,
A., and Bobick, A. Configuration States for the Representation
and Recognition of Gesture, International Workshop on
Automatic Face and Gesture Recognition, 1995. |
|
| Workshop Papers | |
![]() |
Wilson, A. and Robbins, D. C. PlayTogether: Playing Games across Multiple Interactive Tabletops, IUI 2007 Workshop on Tangible Play: Research and Design for Tangible and Tabletop Games. |
|
Wilson, A., and Oliver, N. GWindows: Towards Robust Perception-Based UI, First IEEE Workshop on Computer Vision and Pattern Recognition for Human Computer Interaction, 2003. |
|
|
Wilson, A. Wireless User Interface Devices for Connected Intelligent Environments, Ubicomp 2003 Workshop on Multi-Device Interfaces for Ubiquitous Peripheral Interaction. |
|
| Book Chapters | |
| Wilson, A. 2007. Sensor- and Recognition-Based Input for Interaction, in A. Sears and J. Jacko (editors), The Human Computer Interaction Handbook, Lawrence Erlbaum Associates, 2007. | |
|
Bobick, A., and Wilson, A. State-based Recognition of Gesture, in M. Shah and R. Jain (editors), Motion-Based Recognition, Kluwer Academic Publishers, 1997. |
|
| Journal Articles | |
| Wilson, A., and Bobick, A. Hidden Markov Models for Modeling and Recognizing Gesture Under Variation, International Journal of Pattern Recognition and Artificial Intelligence, 15, 2000, 123-160. | |
|
Pinhanez, C., Davis, J., Intille, S., Johnson, M., Wilson, A., Bobick, A., and Blumberg, B. Physically Interactive Story Environments, IBM Systems Journal, 29 (3/4), 2000. |
|
|
Bobick, A., Intille, S., Davis, J., Baird, F., Pinhanez, C., Campbell, L., Ivanov, Y., Schutte, A., and Wilson, A. The KidsRoom: A Perceptually-Based Interactive and Immersive Story Environment, Presence: Teleoperators and Virtual Environments, Vol. 8, No. 4, August 1999. |
|
|
Wilson, A., and Bobick, A., Parametric Hidden Markov Models for Gesture Recognition, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 21, No. 9, 1999. |
|
|
Peer Reviewed Demonstrations |
|
|
Wilson, A. TouchLight: An Imaging Touch Screen and Display for Gesture-Based Interaction, Siggraph Emerging Technologies, 2005. |
|
|
Wilson, A. A Demonstration of TouchLight, an Imaging Touch Screen and Display for Gesture-Based Interaction, UIST 2004. |
|
|
Wilson, A. WorldCursor: Pointing in Intelligent Environments with a Tele-operated Laser Pointer, UIST 2003. |
|
|
Wilson, A., and Shafer, S. Demonstration of the XWand Interface for Intelligent Spaces, UIST 2002. |
|
|
Blumberg, B., Johnson, M., Hlavac, M., Kline, C., Russel, K., Tomlinson, B., Yoon, S., Wilson, A., Marrin, T., Paradiso, J., Whal, J., Teegarden, Z., Stiehl, D. Swamped! Using Plush Toys to Direct Autonomous Animated Characters, Siggraph Enhanced Realities, 1998. |
|
|
Azarbayejani, A., Wren, C., Wilson, A., Becker, D., Oliver, N., Roy, D., Sparacino, F., Berard, F. Smart Spaces, Siggraph Digital Bayou, 1996. |
|
| Other Stuff | |
|
Wilson, A., and Oliver, N. Multimodal Sensing for Explicit and Implicit Interaction, HCI International 2005. |
|
|
Wilson, A., Adaptive Models for Gesture Recognition, PhD Thesis, Massachusetts Institute of Technology, September 2000. |
|
|
Bobick, A., Intille, S., Davis, J., Baird, F., Pinhanez, C., Campbell, L., Ivanov, Y., Schutte, A., and Wilson, A. The KidsRoom (sidebar), Communications of the ACM Special Issue on Perceptual User Interfaces, 43(3), 2000. |
|
|
Wilson, A. Luxomatic: Computer Vision for Puppeteering, MIT Media Laboratory Perceptual Computing Section Technical Report, 1999. |
|
|
Wilson, A. Learning Visual Behavior for Gesture Analysis, MS Thesis, Massachusetts Institute of Technology, 1995. |