<% Call GetHeader("People") %>

Yong Rui 芮勇

Bio

Beijing Sigma Center
49 Zhichun Road, Haidian District, Beijing 100090
P. R. China
北京市海淀区知春路49号, 100190
希格玛大厦
E-mail: my first name plus (no space) my last name at microsoft dot com

Research | Professional Activities | Publications

I am Director of Microsoft Education Product Group (EdPG) ATC R&D Team. Before this role, from 2006-2008, I was Director of Strategy, Microsoft China R&D Group, where I worked with the Chairman of CRD to drive Microsoft's R&D strategy in China. I returned to China in 2006, after spending seven years in Redmond, where I led the Multimedia Collaboration team in Microsoft Research, Redmond.

Research

My areas of interest include computer vision, signal processing, machine learning, and their applications in communication, collaboration, and multimedia systems. In fact, I am interested in any novel techniques and systems that can enhance people's collaboration experience.

Here are some example projects. To improve remote and/or off-line users' experience, we have developed microphone array sound source localization, real-time person tracking, and particle fliter sensor fusion techniques to construct Automated Lecture Rooms (iCam), and RingCam meeting recording systems. Another project is called WorkLounge, which explores interesting ways to integrate asynchronous collaboration and synchronous collaboration for a distributed project by combining project-specific presence information, project-specific data, and light-weight conferencing tools together.

I also work on some other fun and important projects which have little relationship with collaboration. For example, Automatic Baseball Game Summarization from TV programs, Human Interactive Proof (HIP) using face and facial features, and multimedia information retrieval.

For my PhD work, I was best known for my contribution to image/video indexing, browsing and retrieval. I was one of the first who introduced relevance feedback into multimedia retrieval. Today, in almost all the multimedia conferences you can find at least one session discussing this particular topic. Some of my image/video processing techniques (e.g., shot boundary detection) was shipped with Microsoft MovieMaker 1.0. I have a (slightly outdated) description of my research here.

Professional Activities

Full list of professional activities

I am an Associate Editor of IEEE Transactions on Circuits and Systems for Video Technology, an Associate Editor of ACM Transactions on Multimedia Computing Communication and Applications (TOMCCAP), and on the editorial board of IEEE Multimedia Magazine. I am also on the advisory board of IEEE Transactions on Automation Science and Engineering. I was an Associate Editor of IEEE Transactions on Multimedia 2004-2008, ACM/Springer Multimedia Systems Journal 2005-2007, and was on the Editorial Board of International Journal of Multimedia Tools and Applications 2005-2007. I was on various Organizing Committees and Program Committees including ACM Multimedia, IEEE CVPR, IEEE ECCV, IEEE ACCV, IEEE ICIP, IEEE ICASSP, IEEE ICME, SPIE ITCom, ICPR, CIVR, among others. I was Program Co-Chair of ACM Multimedia 2006, Program Co-Chair of Pacific Rim Multimedia (PCM) 2006, and General Co-Chair of Conference on Image and Video Retrieval (CIVR) 2006. I was on NSF review panel and National Academy of Engineering's Symposium on Frontiers of Engineering for outstanding researchers. I am listed on Marquis Who's Who in America 2007.

Selected Publications

Full list of publications

  • Yong Rui, MPEG-7 Enhanced Ubi-Multimedia Access -- Convergence of User Experience and Technology, Proc. of the First IEEE International Conference on Ubi-media Computing (U-Media 2008) , Lanzhou, China, July 15-16, 2008. [pdf]

  • Bin Yu and Yong Rui, Web Conferencing Systems for Ubi-Media Collaboration: Achievements and Challenges, Proc. of the First IEEE International Conference on Ubi-media Computing (U-Media 2008) , Lanzhou, China, July 15-16, 2008. [pdf]

  • Lu Liu, Yong Rui, Li-Feng Sun, Bo Yang, Jianwei Zhang, Shi-Qiang Yang, Topic mining on web-shared videos, (Lu was the Best Student Paper finalist) Proc. of IEEE ICASSP 2008 , pp. 2145-2148, March 30 - April 4, 2008, Las Vegas, Nevada, USA [pdf]

  • Guo-Jun Qi, Jinhui Tang, Meng Wang, Xian-Sheng Hua, Yong Rui, Tao Mei and Hong-Jiang Zhang, Correlative Multilabel Video Annotation with Temporal Kernels ACM Trans. Multimedia Computing Communication and Appications (TOMCCAP) , Vol. 5, No. 1, 2008. [pdf]

  • Mohan Kankanhalli and Yong Rui, Application potential of multimedia information retrieval Proc. of IEEE, Special Issue on Advances in multimedia information retrieval, Vol. 96, No. 4, pp. 712-720, Apr 2008., [pdf]

  • Cha Zhang, Yong Rui, Jim Crawford and Li-wei He, An Automated End-to-End Lecture Capture and Broadcasting System ACM Trans. Multimedia Computing Communication and Appications (TOMCCAP) , Vol. 4, No. 1, Jan. 2008, [pdf]

  • Guojun Qi, Xiansheng Hua, Yong Rui, Jinhui Tang, Tao Mei, HongJiang Zhang, Correlative multi-label video annocation, (Best Paper Award) Proc. of ACM Multimedia 2007 , Sept. 24-29, 2007, Augsburg, Germany [pdf]

  • Guangyu Zhu, Qingming Huang, Changsheng Xu, Yong Rui, Shuqiang Jiang, Wen Gao, and Hongxun Yao, Trajectory based event tactics analysis in broadcast suports video, Proc. of ACM Multimedia 2007 , Sept. 24-29, 2007, Augsburg, Germany [pdf]

  • Yong Rui, Eric Rudolph, Li-Wei He, Rico Malvar, Michael Cohen, and Ivan Tashev, PING: A Group-to-individual distributed meeting system, Proc. of IEEE ICME 2006 , July 9-12, 2006, Toronto, Canada [pdf]

  • Xun Xu, Yong Rui, and Thomas S. Huang, Recognizing Faces in Recorded Meetings via MRC-Boosting, Proc. of IEEE ICME 2006 , July 9-12, 2006, Toronto, Canada [pdf]

  • Yunqiang Chen and Yong Rui, Chapter 4, Part II: Algorithms I: Real Time Object Tracking in Video Sequences, pages: 67-87. in Interactive Video: Algorithms and Technologies , edited by Riad I. Hammoud, Springer, May 2006. [info]

  • Cha Zhang and Yong Rui, Robust Visual Tracking via Pixel Classification and Integration, Proc. of ICPR 2006 , August 20-24, 2006, HK, China [pdf]

  • Cha Zhang, Pei Yin, Yong Rui, Ross Cutler and Paul Viola, Boosting-Based Multimodal Speaker Detection for Distributed Meetings, Proc. of IEEE MMSP 2006 , Oct 3-6, 2006, Victoria, BC, Canada [pdf]

  • Yong Rui, Anoop Gupta, Jonathan Grudin and Liwei He, Automating lecture capture and broadcast: technology and videography, ACM Multimedia Systems Journal (Springer), 10:3-15 (2004) [pdf]

  • Yong Rui and Zicheng Liu, ARTiFACIAL: Automated Reverse Turing test using FACIAL features, ACM Multimedia Systems Journal (Springer), May 2004 [pdf]

  • Yunqiang Chen and Yong Rui Real-time Speaker Tracking Using Particle Filter Sensor Fusion, Proceedings of the IEEE , vol. 92, no. 3, pp. 485-494, Mar. 2004. [pdf]

  • Tao Wang, Yong Rui, Jia-guang Sun, Constraint Based Region Matching for Image Retrieval, International Journal of Computer Vision (IJCV),, vol.56(1/2), 2004, pp.37-45 [pdf]

  • Zhenqiu Zhang, Yong Rui, Thomas Huang and Cem Paya, Breaking the Clock Face HIP, Proc. of IEEE International Conf. on Multimedia Expo (ICME) 2004, Taipei, Taiwan, June 27-30. [pdf]

  • Xiang Sean Zhou, Yong Rui and Thomas Huang, Exploration of Visual Data, Kluwer Academic Publishers, Boston Hardbound, ISBN 1-4020-7569-3 August 2003, 208 pp. [info]

  • Yong Rui and Dinei Florencio, Time Delay Estimation in the Presence of Correlated Noise and Reverberation, Proc. of IEEE ICASSP 2004 , Montreal, Quebec, Canada, May 17-21. [pdf]

  • Yong Rui and Dinei Florencio, New direct approaches to robust sound source localization, Proc. of IEEE International Conf. on Multimedia Expo (ICME) 2003 , Baltimore, MD, July 6-9, pp. I: 737-740 [pdf]

  • Yong Rui and Thomas Huang, Chapter 7: Learning Based Relevance Feedback in Image Retrieval, in Advances in Image Processing and Understanding: A Festschrift for Thomas S. Huang , World Scientific, Fall 2002. edited by A. C. Bovik, C. W. Chen, and D. Goldfof, pp. 163-182

  • Ross Cutler, Yong Rui, Anoop Gupta, JJ Cadiz, Ivan Tashev, Li-wei He, Alex Colburn, Zhengyou Zhang, Zicheng Liu, Steve Silverberg Distributed Meetings: A Meeting Capture and Broadcasting System, Proc. of ACM Mulitmedia 2002 , Dec. Juan-les-Pins, France [pdf]

  • Yong Rui and Yunqiang Chen, Better Proposal Distributions: Object Tracking Using Unscented Particle Filter, Proc. of IEEE CVPR 2001 , pp. II-786 to 793, Kauai, Hawaii, December 11-13, 2001. [pdf]

  • Yunqiang Chen, Yong Rui and Thomas Huang, JPDAF Based HMM for Real-Time Contour Tracking, (Yunqiang received Outstanding Student Paper Award) , Proc. of IEEE CVPR 2001 , pp.I-543 to 550, Kauai, Hawaii, December 11-13, 2001. [pdf]

  • Yong Rui, Anoop Gupta and J.J. Cadiz, Viewing Meetings Captured by an Omni-Directional Carema, Proc. of ACM CHI 2001 , Seattle, WA, March, 2001. [pdf]

  • Qiong Liu, Yong Rui, Anoop Gupta and J.J. Cadiz, Automating Camera Management in Lecture Room Environments, Proc. of ACM CHI 2001 , Seattle, WA, March, 2001. [pdf]

  • Yong Rui and Thomas S. Huang, Optimizing Learning In Image Retrieval, Proc. of IEEE Int Conf on Computer Vision and Pattern Recognition (CVPR) , Hilton Head, SC, June 2000 [pdf]

  • Yong Rui and Thomas Huang, Chapter 9.2: A Unified Framework for Video Browsing and Retrieval, in The Image and Video Porcessing Handbook edited by Alan Bovik, Academic Press, 2000, pp.705-715. [pdf]

  • Yong Rui, Thomas S. Huang, and Sharad Mehrotra, Constructing Table-of-Content for Videos, ACM Multimedia Systems Journal (Springer),, Special Issue Multimedia Systems on Video Libraries, Vol.7, No.5, Sept, 1999, pp 359-368 [pdf]

  • Yong Rui, Thomas S. Huang, and Shih-Fu Chang, Image Retrieval: Current Techniques, Promising Directions and Open Issues, Journal of Visual Communication and Image Representation , Vol. 10, 39-62, March, 1999 [pdf]

  • Michael Ortega, Yong Rui, Kaushik Chakrabarti, Kriengkrai Porkaew, Sharad Mehrotra, and Thomas S. Huang, Supporting Ranked Boolean Similarity Queries in MARS, IEEE Trans. on Knowledge and Data Engineering , Vol. 10, No. 6, pp905-925, Dec. 1998 [pdf]

  • Yong Rui, Alfred She, and Thomas S. Huang, A Modified Fourier Descriptor for Shape Matching in MARS, in Image Databases and Multimedia Search , Series on Software Engineering and Knowledge Engineering Vol 8, (S. K. Chang Edit), World Scientific Publishing House in Singapore, pp165-180, 1998. [pdf]

  • Yong Rui, Thomas S. Huang, Michael Ortega, and Sharad Mehrotra, Relevance Feedback: A Power Tool in Interactive Content-Based Image Retrieval, IEEE Trans. on Circuits and Systems for Video Technology , Special Issue on Segmentation, Description, and Retrieval of Video Content, pp644-655, Vol 8, No. 5, Sept, 1998 [pdf]

  • Yong Rui, Thomas S. Huang, and Sharad Mehrotra, Content-based Image Retrieval with Relevance Feedback in MARS, Proc. of IEEE Int. Conf. on Image Processing '97 , October 26-29, 1997 Santa Barbara, California, USA, ppII815-818. [pdf]

Some photos


You are the th visitor since 9/9/99.

Copyright © 1995-2004
Last modified 5/01/04 <% Call GetFooter() %>