Microsoft Research
Computational User Experiences

Sensing Gestures Using the Body as an Antenna

Computer vision and inertial measurement have made it possible for people to interact with computers using whole-body gestures. Although there has been rapid growth in the uses and applications of these systems, their ubiquity has been limited by the high cost of heavily instrumenting either the environment or the user. In this paper, we use the human body as an antenna for sensing whole-body gestures. Such an approach requires no instrumentation to the environment, and only minimal instrumentation to the user, thus enabling truly mobile applications. We show robust gesture recognition with an average accuracy of 93% across 12 whole-body gestures, and promising results for robust location classification within a building. In addition, we demonstrate a real-time interactive system which allows a user to interact with a computer using whole-body gestures.


This work is partially supported by Microsoft Research Connections.


Project Team


Download video: [wmv, 35MB] [mp4, 42MB]


An Ultra-Low-Power Human Body Motion Sensor Using Static Electric Field Sensing

Gabe Cohn, Sidhant Gupta, Tien-Jui Lee, Dan Morris, Joshua Smith, Matthew Reynolds, Desney Tan, Shwetak Patel

Proceedings of ACM Ubicomp 2012, September 2012 (Best paper award)

Humantenna: Using the Body as an Antenna for Real-Time Whole-Body Interaction

Gabe Cohn, Dan Morris, Shwetak Patel, Desney Tan

Proceedings of ACM CHI 2012, May 2012 (Best paper nomination)

Your Noise is My Command: Sensing Gestures Using the Body as an Antenna

Gabe Cohn, Dan Morris, Shwetak Patel, Desney S Tan

Proceedings of ACM CHI 2011, May 2011 (Best paper award)



Contact Dan Morris and Desney Tan for questions about our work in this area.

Contact Us Terms of Use Trademarks Privacy Statement ©2010 Microsoft Corporation. All rights reserved.Microsoft