曹翔
Xiang Cao
xiangc [at] microsoft.com
Microsoft Research Asia
Building 2
No. 5 Danling Street, Haidian District
Beijing 100080
China
I am a researcher in the Human-Computer Interaction Group at Microsoft Research Asia. My research is in the general field of Human-Computer Interaction (HCI), with current focuses being next-generation interaction technologies and digital tools to support creativity. My other interests also include computer-supported cooperative activities and user performance modeling.
I first joined Microsoft in the Computer-Mediated Living Group at Microsoft Research Cambridge (UK), where I was also a fellow at Corpus Christi College in the University of Cambridge. In the past I also worked and interned at other research labs such as in Siemens, IBM, and Intel. I received my PhD from the Department of Computer Science at University of Toronto, supervised by Prof. Ravin Balakrishnan.
Along with other professional services, I currently serve as the vice chair of the China Chapter of ACM Special Interest Group on Computer Human Interaction (SIGCHI), working towards promoting HCI research in China and its connection with the international HCI community.
PEER-REVIEWED PUBLICATIONS
Novel Interaction Technologies and Techniques
-
Dominik Schmidt, David Molyneaux, Xiang Cao. (2012). PICOntrol: Using a handheld projector for direct control of physical devices through visible light. Proceedings of UIST 2012, ACM Symposium on User Interface Software and Technology. p. 379-388. UIST 2012 Best Paper Nomination. Video (Download, YouTube).
![]()
-
David Molyneaux, Shahram Izadi, David Kim, Otmar Hilliges, Steve Hodges, Xiang Cao, Alex Butler, Hans Gellersen. (2012). Interactive environment-aware handheld projectors for pervasive computing spaces. Proceedings of Pervasive 2012, International Conference on Pervasive Computing. p. 197-215. Pervasive 2012 Best Paper Award. Video (Download, YouTube).

-
Feng Tian, Fei Lu, Yingying Jiang, Xiaolong (Luke) Zhang, Xiang Cao, Guozhong Dai, Hongan Wang. (2012). An exploration of pen tail gestures for interactions. International Journal of Human-Computer Studies. Vol. 71, Issue 5, p. 551-569.

-
Seokhwan Kim, Xiang Cao, Haimo Zhang, Desney S. Tan. (2012). Enabling concurrent dual views on common LCD Screens. Proceedings of CHI 2012, ACM Conference on Human Factors in Computing Systems. p. 2175-2184. Video (Download, YouTube). Sample images.

-
Haimo Zhang, Xiang Cao, Shengdong Zhao. (2012). Beyond stereo: An exploration of unconventional binocular presentation for novel visual experience. Proceedings of CHI 2012, ACM Conference on Human Factors in Computing Systems. p. 2523-2526. CHI 2012 Best Note Honorable Mention. Video (Download, YouTube).

-
Bo Yi, Xiang Cao, Morten Fjeld, Shengdong Zhao. (2012). Exploring user motivations for eyes-free interaction on mobile devices. Proceedings of CHI 2012, ACM Conference on Human Factors in Computing Systems. p. 2789-2792.

-
Minghui Sun, Xiang Cao, Hyunyoung Song, Shahram Izadi, Hrvoje Benko, Francois Guimbretiere, Xiangshi Ren, Ken Hinckley. (2011). Enhancing naturalness of pen-and-tablet drawing through context sensing. Proceedings of ITS 2011, ACM International Conference on Interactive Tabletops and Surfaces. p. 83-86. Video (Download, YouTube).

-
Hyunyoung Song, Hrvoje Benko, Francois Guimbretiere, Shahram Izadi, Xiang Cao, Ken Hinckley. (2011). Grips and gestures on a multi-touch pen. Proceedings of CHI 2011, ACM Conference on Human Factors in Computing Systems. p. 1323-1332. Video (Download, YouTube).

-
Hrvoje Benko, Shahram Izadi, Andrew D. Wilson, Xiang Cao, Dan Rosenfeld, Ken Hinckley. (2010). Design and evaluation of interaction models for multi-touch mice. Proceedings of GI 2010, Graphics Interface Conference. p. 253-260. Video (Download, YouTube).

-
Xing-Dong Yang, Edward Mak, David McCallum, Pourang Irani, Xiang Cao, Shahram Izadi. (2010). LensMouse: Augmenting the mouse with an interactive touch display. Proceedings of CHI 2010, ACM Conference on Human Factors in Computing Systems. p.2431-2440. CHI 2010 Best Paper Honorable Mention. Video (Download, YouTube).

-
Feng Wang, Xiang Cao, Xiangshi Ren, Pourang Irani. (2009). Detecting and leveraging finger orientation for interaction with direct-touch surfaces. Proceedings of UIST 2009, ACM Symposium on User Interface Software and Technology. p. 23-32.

-
Nicolas Villar, Shahram Izadi, Dan Rosenfeld, Hrvoje Benko, John Helmes, Jonathan Westhues, Steve Hodges, Eyal Ofek, Alex Butler, Xiang Cao, Billy Chen. (2009). Mouse 2.0: Multi-touch meets the mouse. Proceedings of UIST 2009, ACM Symposium on User Interface Software and Technology. p. 33-42. UIST 2009 Best Paper Award. Video (Download, YouTube).

-
Xiang Cao, Andrew D. Wilson, Ravin Balakrishnan, Ken Hinckley, Scott E. Hudson. (2008). ShapeTouch: Leveraging contact shape on interactive surfaces. Proceedings of TABLETOP 2008, IEEE International Workshop on Tabletops and Interactive Surfaces. p. 139-146. Video (Download, YouTube).

-
Xiang Cao, Clifton Forlines, Ravin Balakrishnan. (2007). Multi-user interaction using handheld projectors. Proceedings of UIST 2007, ACM Symposium on User Interface Software and Technology. p. 43-52. Video (Download, YouTube).

-
Xiang Cao, Ravin Balakrishnan. (2006). Interacting with dynamically defined information spaces using a handheld projector and a pen. Proceedings of UIST 2006, ACM Symposium on User Interface Software and Technology. p. 225-234. Video (Download, YouTube).

-
Xiang Cao, Ravin Balakrishnan. (2005). Evaluation of an online adaptive gesture interface with command prediction. Proceedings of GI 2005, Graphics Interface Conference. p. 187-194. GI 2005 Best Student Paper Award.

-
Xiang Cao, Ravin Balakrishnan. (2003). VisionWand: Interaction techniques for large displays using a passive wand tracked in 3D. Proceedings of UIST 2003, ACM Symposium on User Interface Software & Technology. p. 193-202. One of 3 papers invited to the UIST reprise session at ACM SIGGRAPH 2004. Video (Download, YouTube).

-
Xiang Cao, Baining Guo. (2002). Real-time tracking and imitation of facial expression. Proceedings of ICIG 2002, SPIE International Conference on Image and Graphics. p. 910-918.

Digital Tools to Support Creativity
-
Jun Kato, Sean McDirmid, Xiang Cao. (2012). DejaVu: Integrated support for developing interactive camera-based programs. Proceedings of UIST 2012, ACM Symposium on User Interface Software and Technology. p. 189-196. Video (Download, YouTube).

-
Guang Li, Xiang Cao, Sergio Paolantonio, Feng Tian. (2012). SketchComm: A tool to support rich and flexible asynchronous communication of early design ideas. Proceedings of CSCW 2012, ACM Conference on Computer Supported Cooperative Work. p. 359-368. Video (Download, YouTube).

-
Fei Lu, Feng Tian, Yingying Jiang, Xiang Cao, Wencan Luo, Guang Li, Xiaolong Zhang, Guozhong Dai, Hongan Wang. (2011). ShadowStory: Creative and collaborative digital storytelling inspired by cultural heritage. Proceedings of CHI 2011, ACM Conference on Human Factors in Computing Systems. p. 1919-1928. Video (Download, YouTube).
-
Yang Li, Xiang Cao, Katherine Everitt, Morgan Dixon, James A. Landay. (2010). FrameWire: A tool for automatically extracting interaction logic from paper prototyping tests. Proceedings of CHI 2010, ACM Conference on Human Factors in Computing Systems. p. 503-512. Video (Download, YouTube).

-
Xiang Cao, Siân E. Lindley, John Helmes, Abigail Sellen. (2010). Telling the whole story: Anticipation, inspiration and reputation in a field deployment of TellTable. Proceedings of CSCW 2010, ACM Conference on Computer Supported Cooperative Work. p. 251-260. Video (Download, YouTube), Project Page.

-
John Helmes, Xiang Cao, Siân E. Lindley, Abigail Sellen. (2009). Developing the story: Designing an interactive storytelling application. Proceedings of ITS 2009, ACM International Conference on Interactive Tabletops and Surfaces. p. 49-52. Video (Download, YouTube), Project Page.

Living, Playing, and Working in the Social Realm
-
John C. Tang, Jennifer Marlow, Aaron Hoff, Asta Roseway, Kori Inkpen, Chen Zhao, Xiang Cao. (2012). Time travel proxy: Using lightweight video recordings to create asynchronous, interactive meetings. Proceedings of CHI 2012, ACM Conference on Human Factors in Computing Systems. p. 3111-3120. Video (Download, YouTube).
-
Yan Xu, Xiang Cao, Abigail Sellen, Ralf Herbrich, Thore Graepel. (2011). Sociable killers: Understanding social relationships in an online first-person shooter game. Proceedings of CSCW 2011, ACM Conference on Computer Supported Cooperative Work. p. 197-206.

-
John C. Tang, Chen Zhao, Xiang Cao, Kori Inkpen. (2011). Your time zone or mine? A study of globally time zone-shifted collaboration. Proceedings of CSCW 2011, ACM Conference on Computer Supported Cooperative Work. p. 235-244.

-
John Helmes, Alex S. Taylor, Xiang Cao, Kristina Höök, Peter Schmitt, Nicolas Villar. (2011). Rudiments 1, 2 & 3: Design speculations on autonomy. Proceedings of TEI 2011, International Conference on Tangible, Embedded and Embodied Interaction. p. 145-152.

-
Xiang Cao, Abigail Sellen, A.J. Bernheim Brush, David Kirk, Darren Edge, Xianghua Ding. (2010). Understanding family communication across time zones. Proceedings of CSCW 2010, ACM Conference on Computer Supported Cooperative Work. p. 155-158.

- David Kirk, Abigail Sellen, Xiang Cao. (2010). Home video communication: Mediating ‘closeness’. Proceedings of CSCW 2010, ACM Conference on Computer Supported Cooperative Work. p. 135-144.

- Xiang Cao, Michael Massimi, Ravin Balakrishnan. (2008). Flashlight jigsaw: An exploratory study of an ad-hoc multi-player game on public displays. Proceedings of CSCW 2008, ACM Conference on Computer Supported Cooperative Work. p. 77-86.

Measuring and Modeling User Performance
-
Jin Ryong Kim, Xiaowei Dai, Xiang Cao, Carl Picciotto, Desney Tan, Hong Z. Tan. (2012). A masking study of key-click feedback signals on a virtual keyboard. Proceedings of EuroHaptics Conference 2012. p. 247-257.
-
Feng Tian, Xiang Cao, Fei Lu, Guozhong Dai, Xiaolong Zhang, Hongan Wang. (2011). Empirical studies of pen tilting performance in pen-based user interfaces. Proceedings of VINCI 2011, Visual Information Communication - International Symposium. Article 8, p. 1-10.
-
Xiang Cao, Nicolas Villar, Shahram Izadi. (2010). Comparing user performance with single-finger, whole-hand, and hybrid pointing devices. Proceedings of CHI 2010, ACM Conference on Human Factors in Computing Systems. p. 1643-1646.

- Minghui Sun, Xiangshi Ren, Xiang Cao. (2009). Effects of multimodal error feedback on human performance in steering tasks. Proceedings of FIT 2009, Forum on Information Technology. p. 51-56. FIT 2009 Paper Award.

- Xiaolei Zhou, Xiang Cao, Xiangshi Ren. (2009). Speed-accuracy tradeoff in trajectory-based tasks with temporal constraint. Proceedings of INTERACT 2009, IFIP Conference on Human-Computer Interaction. p. 906-919.

- Xiang Cao, Jacky Jie Li, Ravin Balakrishnan. (2008). Peephole pointing: Modeling acquisition of dynamically revealed targets. Proceedings of CHI 2008, ACM Conference on Human Factors in Computing Systems. p. 1699-1708. CHI 2008 Best Paper Honorable Mention.

- Xiang Cao, Shumin Zhai. (2007). Modeling human performance of pen stroke gestures. Proceedings of CHI 2007, ACM Conference on Human Factors in Computing Systems. p. 1495-1504.

OTHER PUBLICATIONS
Invited Papers/Articles
-
Shumin Zhai, Per Ola Kristensson, Caroline Appert, Tue Haste Andersen, Xiang Cao. (2012). Foundational issues in touch-surface stroke gesture design - An integrative review. Foundations and Trends in Human–Computer Interaction. Vol. 5, No. 2, p. 97–205.
-
Xiang Cao. (2011). 自然用户界面自然在哪儿?(What makes natural user interface "natural"?). Communications of the China Computer Federation (in Chinese). Vol. 7, No. 11, p. 14-18.
-
Minghui Sun, Xiangshi Ren, Xiang Cao. (2010). Effects of multimodal error feedback on human performance in steering tasks. Information Processing Society of Japan (IPSJ) Journal (Paper recommended by FIT 2009). Vol. 51, No. 12, p. 2375–2383.
-
Xiang Cao, Ravin Balakrishnan. (2004). VisionWand: Interaction techniques for large displays using a passive wand tracked in 3D. ACM Transactions on Graphics, 23(3). Proceedings of SIGGRAPH 2004 Conference (Invited reprise of UIST 2003). p. 729.
Book Chapter
- Xiang Cao. (2012). Connecting families across time zones. In Connecting Families: The Impact of New Communication Technologies on Domestic Life. p. 127-139. Editors: Carman Neustaedter, Steve Harrison, Abigail Sellen. Springer.
Demos, Posters, Tech Reports, etc.
-
Xiaowei Dai, Jiawei Gu, Xiang Cao, J. Edward Colgate, Hong Tan. (2012). SlickFeel: Sliding and clicking haptic feedback on a touchscreen. (Demo). Adjunct proceedings of UIST 2012, ACM Symposium on User Interface Software and Technology. p. 21-22. Video (Download, YouTube).
-
Nan Zhao, Xiang Cao, Jaturont Jamigranont. (2012). Ferro tale: Electromagnetic animation interface. (Video). Video Showcase of CHI 2012, ACM Conference on Human Factors in Computing Systems. Video (Download, YouTube).
-
Yuhang Zhao, Chao Xue, Xiang Cao, Yuanchun Shi. (2011). PicoPet: "Real world" digital pet on a handheld projector. (Demo). Adjunct Publication of UIST 2011, ACM Symposium on User Interface Software and Technology. p. 1-2. Video (Download, YouTube).
-
Xiang Cao, Shumin Zhai. (2006). Modeling human performance of pen stroke gestures. IBM Research Report RJ10392. p. 1-12.
-
Xiang Cao, Eyal Ofek, David Vronay. (2005). Evaluation of alternative presentation control techniques. (Poster). Extended Abstracts of CHI 2005, ACM Conference on Human Factors in Computing Systems. p. 1248-1251.
-
Xiang Cao, Guangyou Xu. (2000). Segmentation and tracking of semantic objects in video. Proceedings of NCMT 2000, National Conference of Multimedia Technology (in Chinese).
Theses
-
Xiang Cao. (2008). Handheld projector interaction. Ph. D. Thesis. Department of Computer Science, University of Toronto.
-
Xiang Cao. (2004). An exploration of gesture-based interaction. M. Sc. Thesis. Department of Computer Science, University of Toronto.
-
Xiang Cao. (2000). Segmentation and tracking of semantic objects in video. B. Eng. Thesis. Department of Computer Science and Technology, Tsinghua University.
PATENTS FILED
-
Xiang Cao, Seokhwan Kim, Haimo Zhang, Desney S. Tan. (2012). Simultaneous display of multiple content items. U.S. patent application filed on 22 June 2012. Pending.
-
Xiang Cao, Haimo Zhang. (2012). User perception of visual effects. U.S. patent application filed on 1 May 2012. Pending.
-
Xiang Cao, Dominik Schmidt, David Geoffrey Molyneaux. (2012). Controlling a device with visible light. U.S. patent application filed on 23 March 2012. Pending.
-
Yingnong Dang, Sergio Paolantonio, Xiang Cao, Xiumin Lin, Dongmei Zhang. (2012). Consumption of content with reactions of an individual. U.S. patent application filed on 10 January 2012. Pending.
-
Aaron Hoff, Kori Inkpen Quinn, Paul Johns, Asta Roseway, Chen Zhao, Xiang Cao, Jennifer Marlow, John C. Tang. (2011). Proxy for asynchronous meeting participation. U.S. patent application filed on 24 November 2011. Pending.
-
Xiang Cao, Guang Li, Sergio Paolantonio. (2011). Techniques to facilitate asynchronous communication. U.S. patent application filed on 19 October 2011. Pending.
-
Xiang Cao, Minghui Sun, Shahram Izadi, Hrvoje Benko, Kenneth P Hinckley. (2011). Multi-touch input device with orientation sensing. U.S. patent application filed on 11 February 2011. Pending.
-
John Helmes, Shahram Izadi, Xiang Cao, Nicolas Villar, Richard Banks. (2010). User Input Device. U.S. patent application filed on 29 October 2010. Pending.
-
Xiang Cao, John Helmes, Abigail Sellen, Richard Banks. (2010). Sketching and searching application for idea generation. U.S. patent application filed on 3 June 2010. Pending.
-
Hrvoje Benko, Shahram Izadi, Andrew D Wilson, Daniel Rosenfeld, Ken Hinckley, Xiang Cao, Nicolas Villar, Stephen Hodges. (2010). Multi-touch user interface interaction. U.S. patent application filed on 16 March 2010. Pending.
-
John Helmes, Nicolas Villar, Hrvoje Benko, Shahram Izadi, Daniel Rosenfeld, Stephen Hodges, David Alexander Butler, Xiang Cao, Richard Banks. (2009). Indirect multi-touch interaction. U.S. patent application filed on 1 October 2009. Pending.
-
Xiang Cao, John Helmes, Abigail Sellen, Siân Elizabeth Lindley. (2009). Creating animations. U.S. patent No. 8325192. Filed on 10 July 2009. Granted on 4 December 2012.
-
Nicolas Villar, John Helmes, Shahram Izadi, Daniel Rosenfeld, Stephen E Hodges, David Alexander Butler, Xiang Cao, Otmar Hilliges, Richard Banks, Benjamin David Eidelson, Hrvoje Benko. (2009). Pointing device with independently movable portions. U.S. patent application filed on 16 June 2009. Pending.
PROFESSIONAL SERVICES
Program Committees and Referee Duties
- Program committee. ACM Conference on Human Factors in Computing Systems (CHI) 2013.
- Program committee. ACM Conference on Human Factors in Computing Systems (CHI) 2012.
- Program committee. ACM Symposium on User Interface Software and Technology (UIST) 2012.
- Program committee. Asia Pacific Conference on Computer Human Interaction (APCHI) 2012.
- Program committee. Workshop on Kinect in Pervasive Computing, in conjunction with Pervasive 2012,
- Program committee. ACM Conference on Human Factors in Computing Systems (CHI) 2011.
- Referee. Microsoft 2011 Collaborative Research (CORE) Funding Program in Japan.
- Program co-chair. IEEE International Conference on Information and Automation (ICIA) 2010.
- Jury member. Austrian research funding program on Research and Innovation for Information Technologies (FIT-IT) 2009.
- Paper reviewer for numerous conferences and journals, e.g. CHI, UIST, CSCW, TOCHI, SIGGRAPH ...
Conference Organization
-
Session chair. Fabrication and Hardware paper session at ACM UIST 2012.
-
Session chair. I Am How I Touch: Authenticating Users paper session at ACM CHI 2012.
-
Session chair. Non-Flat Displays paper session at ACM CHI 2011.
-
Co-organizer. China Symposium on Human Computer Interaction 2011.
-
Co-organizer. Designing Social and Collaborative Systems for China workshop at ACM CSCW 2011.
-
Co-organizer. Connecting Families: New Technologies, Family Communication, and the Impact on Domestic Space workshop at ACM GROUP 2010.
-
Demonstrations co-chair. ACM Symposium on User Interface Software and Technology (UIST) 2009.
-
Demonstrations co-chair. ACM Symposium on User Interface Software and Technology (UIST) 2008.
Others
-
Vice Chair. ACM Special Interest Group on Computer Human Interaction (SIGCHI) China Chapter. 2011-present.
-
Keynote speaker (title: "Unleashing full potential for everybody and everything"). International Conference on Intelligent Human Computer Interaction (IHCI) 2012.
-
Member of governing body, visiting fellows committee, and computer committee. Corpus Christi College, University of Cambridge. 2008-2010.
-
Academic supervisor for undergraduate computer science students at University of Cambridge. 2009-2010.
RESEARCH SUPERVISION
- Yineng Chen. Research intern at Microsoft Research Asia, from Chinese Academy of Sciences. 2012-2013.
- Xuyong Yang. Research intern at Microsoft Research Asia, from University of Science and Technology of China. 2012-2013.
- Chihiro Suga. Research intern at Microsoft Research Asia, from Ochanomizu University. 2012.
- Yupeng Zhang. Research intern at Microsoft Research Asia, from University of Science and Technology of China. 2012-2013.
-
Xing-Dong Yang. Research intern at Microsoft Research Asia, from University of Alberta. 2012.
-
Zhimin Ren. Research intern at Microsoft Research Asia, from University of North Carolina at Chapel Hill. 2012.
-
Stanford University / University of Science and Technology of China joint team. Design Innovation Course (ME310) at Stanford University. 2011-2012.
-
Jun Kato. Research intern at Microsoft Research Asia, from University of Tokyo. 2012.
-
Shang Ma. Research intern at Microsoft Research Asia, from Tsinghua University, co-supervised with Ying-Qing Xu. 2012.
-
Jessica Cauchard. Research intern at Microsoft Research Asia, from University of Bristol. 2011-2012.
-
Teng Han. Research intern at Microsoft Research Asia, from University of Bristol. 2011-2012.
-
Jizhou Yan. Research intern at Microsoft Research Asia, from Beihang University, co-supervised with Xin Ma and Chunshui Zhao. 2011-2012.
-
Dominik Schmidt. Research intern at Microsoft Research Asia, from Lancaster University. 2011.
-
Haimo Zhang. Research intern at Microsoft Research Asia, from National University of Singapore. 2011.
-
Adiyan Mujibiya. Research intern at Microsoft Research Asia, from University of Tokyo, co-supervised with Desney Tan. 2011.
-
Seokhwan Kim. Research intern at Microsoft Research Asia, from University of Tsukuba, co-supervised with Desney Tan. 2011.
-
Nan Zhao. Research intern at Microsoft Research Asia, from RWTH Aachen University. 2011.
-
Yuhang Zhao. Research intern at Microsoft Research Asia, from Tsinghua University. 2010-2011.
-
Guang Li. Research intern at Microsoft Research Asia, from Chinese Academy of Sciences. 2010-2011.
-
Minghui Sun. Research intern at Microsoft Research Cambridge, from Kochi University of Technology. 2010.
-
Yan Xu. Research intern at Microsoft Research Cambridge, from Georgia Institute of Technology. 2009.
-
Boon Yew Chew. Master's thesis at University College London, co-supervised with Jennifer A. Rode and Abigail Sellen. 2009.
-
Serena Kao. Undergraduate research assistant at University of Toronto. 2008.
-
Clarissa Mak. Undergraduate research assistant at University of Toronto. 2008.
-
Jacky Jie Li. Undergraduate research assistant at University of Toronto. 2007.
-
Janek Lasocki-Biczysko. Undergraduate research assistant at University of Toronto, co-supervised with Tomer Moscovich. 2007.
-
Shuo Zhao. Research intern at Siemens Ltd., China, from Peking University. 2005.
(This web page last updated on 8th April 2013.)
