Andy Wilson

 

I am a principal researcher at Microsoft Research. My work is focused on applying sensing techniques to enable new styles of human-computer interaction. Today that means multi-touch and gesture-based interfaces, display technologies, depth cameras and so-called "natural" interfaces. In 2002 I helped found the Surface Computing group at Microsoft. I manage the Natural Interaction Research group at Microsoft Research.

Before joining Microsoft, I obtained my BA at Cornell University, and MS and PhD at the MIT Media Laboratory. I grew up in a small town in Pennsylvania and now live in the Wallingford neighborhood of Seattle.

I use this page primarily to list my academic publications. It was last edited on October 13, 2013.

My business card has my contact info. You can view many videos of my work on my YouTube channel.

I gave a talk on my research at the BUILD conference in 2012. You can watch it here.

research.microsoft.com ran a feature story on some of our work at Siggraph.

Here is some fun unpublished work:



Professional Activities

I've been active in the UIST, CHI, Tabletop (now Interactive Tabletops and Surfaces), ICMI, and Ubicomp academic communities, where I've have had the pleasure of serving on various program committees. I co-chaired Tabletop 2007 and chaired UIST 2009. I tend to publish under the name "Andrew D. Wilson".

Conference Papers

  Willis, K., and Wilson, A. InfraStructs: Fabricating Information Inside Physical Objects for Imaging in the Terahertz Region. Siggraph 2013.
Jones, B., Benko, H., Ofek, E., and Wilson, A. IllumiRoom: Peripheral Projected Illusions for Interactive Experiences. CHI 2013. Best Paper Award.
Wilson, A., Benko, H., Izadi, S., and Hilliges, O. Steerable Augmented Reality with the Beamatron. UIST 2012.
Benko, H., Jota, R., and Wilson, A. MirageTable: Freehand Interaction on a Projected Augmented Reality Tabletop. CHI 2012.
  Sodhi, R., Benko, H., and Wilson, A. LightGuide: Projected Visualizations for Hand Movement Guidance. CHI 2012.
  Rofouei, M., Wilson, A., Brush, A.J., and Tansley, S. Your Phone or Mine?: Fusing Body, Touch, and Device Sensing for Multi-User Device-Display Interaction. CHI 2012.
  Schwarz, J., Kilonsky, D., Harrison, C., Dietz, P., and Wilson, A. Phone as a Pixel: Enabling Ad-hoc, Large-Scale Displays Using Mobile Devices. CHI 2012.
  Hilliges, O., Kim, D., Izadi, S., Weiss, M., and Wilson, A. HoloDesk: Direct 3d Interactions with a Situated See-Through Display. CHI 2012.
  Harrison, C., Benko, H., and Wilson, A. OmniTouch: Wearable Multitouch Interaction Everywhere. UIST 2011.
  Holz, C. and Wilson, A. Data Miming: Inferring Spatial Object Descriptions from Human Gesture. CHI 2011.
Benko, H. and Wilson, A. Multi-Point Interactions with Immersive Omnidirectional Visualizations in a Dome. Interactive Tabletops and Surfaces 2010.
Wilson, A. Using a Depth Camera as a Touch Sensor. Interactive Tabletops and Surfaces 2010.
Wilson, A., and Benko, H. Combining Multiple Depth Cameras and Projectors for Interactions On, Above and Between Surfaces. UIST 2010.
Hinckley, K., Yatani, K., Pahud, M., Coddington, N., Rodenhouse, J., Wilson, A., Benko, H., and Buxton, B. Pen + Touch = New Tools. UIST 2010.
  Schwarz, J., Hudson, S., Mankoff, J. and Wilson, A. A Framework for Robust and Flexible Handling of Inputs with Uncertainty. UIST 2010.

Morris, M. R., Wobbrock, J. O., and Wilson, A.D. Understanding Users’ Preferences for Surface Gestures. Graphics Interface 2010.

Benko, H., Izadi, S., Wilson, A. D., Cao, X., Rosenfeld, D., and Hinckley, K. Design and Evaluation of Interaction Models for Multi-touch Mice. Graphics Interface 2010.

 

Hinckley, K., Yatani, K., Pahud, M., Coddington, N., Rodenhouse, J., Wilson, A., Benko, H., and Buxton, B. Manual Deskterity: An Exploration of Simultaneous Pen + Touch Direct Input. ACM CHI 2010 Extended Abstracts (alt.chi).

Hartmann, B., Morris, M. R., Benko, H., and Wilson, A. Pictionaire: Supporting Collaborative Design Work by Integrating Physical and Digital Artifacts, CSCW 2010.

Wilson, A. Simulating Grasping Behavior on an Imaging Interactive Surface, Interactive Tabletops and Surfaces 2009.

Hilliges, O., Izadi, S., Wilson, A., Hodges, S., Garcia-Mendoza, A., and Butz, A. Interactions in the Air: Adding Further Depth to Interactive Tabletops, UIST 2009.

Hartmann, B., Morris, M. R., Benko, H., and Wilson, A. Augmenting Interactive Tables with Mice and Keyboards, UIST 2009.

Nacenta, M., Baudisch, P., Benko, H., and Wilson, A. Separability of Spatial Manipulations in Multi-touch Interfaces, Graphics Interface 2009.

Wobbrock, J. O., Morris, M. R., and Wilson, A. User-Defined Gestures for Surface Computing, CHI 2009.

Wilson, A., Izadi, S., Hilliges, O., Garcia-Mendoza, A., and Kirk, D. Bringing Physics to the Surface, UIST 2008. Best Paper Award.

Benko, H., Wilson, A. and Balakrishnan, R. Sphere: Multi-touch Interactions on a Spherical Display, UIST 2008.

Everitt, K., Morris, M. R., Brush, A., and Wilson, A. DocuDesk: An Interactive Surface for Creating and Rehydrating Many-to-Many Linkages among Paper and Digital Documents, Tabletop 2008.

Cao, X., Wilson, A., Balakrishnan, R., Hinckley, K., and Hudson, S. ShapeTouch: Leveraging Contact Shape on Interactive Surfaces, Tabletop 2008.

Olwal, A., and Wilson, A. SurfaceFusion: Unobtrusive Tracking of Everyday Objects in Tangible User Interfaces, Graphics Interface 2008.

Wilson, A. Depth-Sensing Video Cameras for 3D Tangible Tabletop Interaction, Tabletop 2007.

Wobbrock, J. O., Wilson, A., and Li, Y. Gestures without Libraries, Toolkits or Training: A $1 Recognizer for User Interface Prototypes, UIST 2007.

Wilson, A. and Sarin, R. BlueTable: Connecting Wireless Mobile Devices on Interactive Surfaces Using Vision-Based Handshaking, Graphics Interface 2007.

Baudisch, P., Sinclair, M., and Wilson, A. Soap: A Pointing Device that Works in Mid-Air, UIST 2006.

Wilson, A. Robust Vision-Based Detection of Pinching for One and Two-Handed Input, UIST 2006.

Benko, H., Wilson, A., and Baudisch, P. Precise Selection Techniques for Multi-Touch Screens, CHI 2006.

Wilson, A., and Agrawala, M. Text Entry Using a Dual Joystick Game Controller, CHI 2006.

Wilson, A. PlayAnywhere: A Compact Tabletop Computer Vision System, UIST 2005.

Wilson, A., and Cutrell, E. FlowMouse: A Computer Vision-Based Pointing and Gesture Input Device, Interact 2005.

Wilson, A. TouchLight: An Imaging Touch Screen and Display for Gesture-Based Interaction, International Conference on Multimodal Interfaces 2004.

Paek, T., Agrawala, M., Basu, S., Drucker, S., Kristjansson, T., Logan, R., Toyama, K., and Wilson, A. Toward Universal Mobile Interaction for Shared Displays, CSCW 2004.

Wilson, A., and Oliver, N. GWindows: Robust Stereo Vision for Gesture-Based Control of Windows, International Conference on Multimodal Interfaces 2003.

Wilson, A., and Pham, H. Pointing in Intelligent Environments with the WorldCursor, Interact 2003.

Wilson, A., and Shafer, S. XWand: UI for Intelligent Spaces, CHI 2003.

 

Wilson, A., and Bobick, A. Realtime Online Adaptive Gesture Recognition, International Conference on Pattern Recognition, 2000.

Johnson, M., Wilson, A., Kline, C., Blumberg, B. and Bobick, A. Sympathetic Interfaces: Using a Plush Toy to Direct Synthetic Characters, CHI 1999.

 

Wilson, A., and Bobick, A. Nonlinear PHMMs for the Interpretation of Parameterized Gesture, Computer Vision and Pattern Recognition, 1998.

 

Wilson, A., and Bobick, A. Recognition and Interpretation of Parametric Gesture, International Conference on Computer Vision,  1998.

 

Wilson, A., Bobick, A., and Cassell, J. Recovering the Temporal Structure of Natural Gesture, Second International Conference on Automatic Face and Gesture Recognition, 1996.

 

Wilson, A., Cassell, J., and Bobick, A. Temporal Classification of Natural Gesture and Application to Video Coding, Computer Vision and Pattern Recognition, 1997.

 

Wilson, A., and Bobick, A. Learning Visual Behavior for Gesture Analysis, IEEE International Symposium on Computer Vision, 1995.

 

Bobick, A., and Wilson, A. A State-Based Technique for the Summarization and Recognition of Gesture, International Conference on Computer Vision, 1995.

 

Wilson, A., and Bobick, A. Configuration States for the Representation and Recognition of Gesture, International Workshop on Automatic Face and Gesture Recognition, 1995.

  Workshop Papers

Wilson, A. and Robbins, D. C. PlayTogether: Playing Games across Multiple Interactive Tabletops, IUI 2007 Workshop on Tangible Play: Research and Design for Tangible and Tabletop Games.

 

Wilson, A., and Oliver, N. GWindows: Towards Robust Perception-Based UI, First IEEE Workshop on Computer Vision and Pattern Recognition for Human Computer Interaction, 2003.

 

Wilson, A. Wireless User Interface Devices for Connected Intelligent Environments, Ubicomp 2003 Workshop on Multi-Device Interfaces for Ubiquitous Peripheral Interaction.

  Book Chapters
  Wilson, A. 2007. Sensor- and Recognition-Based Input for Interaction, in A. Sears and J. Jacko (editors), The Human Computer Interaction Handbook, Lawrence Erlbaum Associates, 2007.

Bobick, A., and Wilson, A. State-based Recognition of Gesture, in M. Shah and R. Jain (editors), Motion-Based Recognition, Kluwer Academic Publishers, 1997.

  Journal Articles
  Wilson, A., and Bobick, A. Hidden Markov Models for Modeling and Recognizing Gesture Under Variation, International Journal of Pattern Recognition and Artificial Intelligence, 15, 2000, 123-160.
 

Pinhanez, C., Davis, J., Intille, S., Johnson, M., Wilson, A., Bobick, A., and Blumberg, B. Physically Interactive Story Environments, IBM Systems Journal, 29 (3/4), 2000.

 

Bobick, A., Intille, S., Davis, J., Baird, F., Pinhanez, C., Campbell, L., Ivanov, Y., Schutte, A., and Wilson, A. The KidsRoom: A Perceptually-Based Interactive and Immersive Story Environment, Presence: Teleoperators and Virtual Environments, Vol. 8, No. 4, August 1999.

 

Wilson, A., and Bobick, A., Parametric Hidden Markov Models for Gesture Recognition, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 21, No. 9, 1999.

Peer Reviewed Demonstrations

 

Jones, B., Benko, H., Ofek, E., and Wilson, A. IllumiRoom: Peripheral Projected Illusions for Interactive Experiences, Siggraph Emerging Technologies, 2013.

 

Wilson, A. TouchLight: An Imaging Touch Screen and Display for Gesture-Based Interaction, Siggraph Emerging Technologies, 2005.

 

Wilson, A. A Demonstration of TouchLight, an Imaging Touch Screen and Display for Gesture-Based Interaction, UIST 2004.

 

Wilson, A. WorldCursor: Pointing in Intelligent Environments with a Tele-operated Laser Pointer, UIST 2003.

 

Wilson, A., and Shafer, S. Demonstration of the XWand Interface for Intelligent Spaces, UIST 2002.

 

Blumberg, B., Johnson, M., Hlavac, M., Kline, C., Russel, K., Tomlinson, B., Yoon, S., Wilson, A., Marrin, T., Paradiso, J., Whal, J., Teegarden, Z., Stiehl, D. Swamped! Using Plush Toys to Direct Autonomous Animated Characters, Siggraph Enhanced Realities, 1998.

 

Azarbayejani, A., Wren, C., Wilson, A., Becker, D., Oliver, N., Roy, D., Sparacino, F., Berard, F. Smart Spaces, Siggraph Digital Bayou, 1996.

  Other Stuff
 

Wilson, A., and Oliver, N. Multimodal Sensing for Explicit and Implicit Interaction, HCI International 2005.

 

Wilson, A., Adaptive Models for Gesture Recognition, PhD Thesis, Massachusetts Institute of Technology, September 2000.

 

Bobick, A., Intille, S., Davis, J., Baird, F., Pinhanez, C., Campbell, L., Ivanov, Y., Schutte, A., and Wilson, A. The KidsRoom (sidebar), Communications of the ACM Special Issue on Perceptual User Interfaces, 43(3), 2000.

 

Wilson, A. Luxomatic: Computer Vision for Puppeteering, MIT Media Laboratory Perceptual Computing Section Technical Report, 1999.

 

Wilson, A. Learning Visual Behavior for Gesture Analysis, MS Thesis, Massachusetts Institute of Technology, 1995.

 

style17"> 

style17"> 

style17"> 

style17">