Dr. Tao MEI | Microsoft Research Asia


	Tao MEI, Ph.D.

	Research Staff Member
	Media Computing Group \| Microsoft Research Asia
	5F Sigma, 49 Zhichun Road
	Beijing 100190, P. R. China
	Tel:	+ 86 - 10 - 5896 3036
	Fax:	+ 86 - 10 - 8809 7306
	Email:
	Personal:
	CV:	[PDF]

Bio Dr. Tao Mei received the B.E. degree in automation and the Ph.D. degree in pattern recognition and intelligent systems from the University of Science and Technology of China, Hefei, in 2001 and 2006, respectively. He joined Microsoft Research Asia, Beijing, China, as a Researcher Staff Member, in 2006. He is a visiting professor of the Xidian University during 2009-2012. His current research interests include multimedia content analysis, computer vision, and internet multimedia applications such as search, advertising, management, social network, mobile applications. He is the author of one book, six book chapters, and over 80 journal and conference papers in these areas, and holds more than 20 filed international and U.S. patents or pending applications. Dr. Mei serves as an Editorial Board Member for Journal of Multimedia (Academy) and Neurocomputing (Elsevier), a Guest Editor for IEEE Multimedia for the Special Issue on "Knowledge Discovery over Community-Contributed Multimedia Data: Opportunities and Challenges," ACM/Springer Multimedia Systems for the Special Issue on "Multimedia Intelligent Services and Technologies," and Elsevier Journal of Visual Communication and Image Representation for the Special Issue on "Large-Scale Image and Video Search: Challenges, Technologies, and Trends," a Technical Program Committee Member for numerous international conferences, and a Technical Reviewer for over 20 prestigious international journals. He was the principle designer of the automatic video search system that achieved the best performance in the worldwide TRECVID evaluation in 2007. He received the Best Paper and Best Demonstration Awards in the ACM International Conference on Multimedia 2007, the Best Poster Paper Award in the IEEE International Workshop on Multimedia Signal Processing 2008, and the Best Paper Award in the ACM International Conference on Multimedia 2009. He is a Member of the IEEE and the ACM.

* New: Online Multimedia Advertising, a book to be published by IGI Global. [Updates for Preparing Book Chapters]
*Notes: I am always looking for outstanding research and development interns. If you are interested in multimedia related research and projects, please do not hesitate to send your resume to me.

Representative Publications [full list by year] [full list by categories] [DBLP]

Visual Query Suggestion

Zheng-Jun Zha, Linjun Yang, Tao Mei, et al.
ACM Multimedia, pp.15-24, 2009
Best Paper Award from SIGMM 2009

This paper proposes a new query suggestion scheme named Visual Query Suggestion which is dedicated to image search. It provides a more effective query interface to formulate an intent-specific query by joint text and image suggestions.

Contextual In-Image Advertising

Tao Mei, Xian-Sheng Hua, Shipeng Li
ACM Multimedia, pp. 439-448, 2008.

ImageSense is an innovative contextual advertising system driven by images, which automatically associates relevant ads with an image rather than the entire text in a Web page and seamlessly inserts the ads in the nonintrusive areas within each individual image.

VideoSense - Towards Effective Online Video Advertising

Tao Mei, Xian-Sheng Hua, Linjun Yang, Shipeng Li
ACM Multimedia, pp. 1075-1084, 2007.

VideoSense is a novel advertising system for online video service, which automatically associates the most relevant video ads with videos and seamlessly inserts the ads at the most appropriate positions within each video. VideoSense aims to embed more contextually relevant ads at less intrusive positions within video stream.

Video Collage: Presenting a Video Sequence Using a Single Image

Tao Mei, Bo Yang, Shi-Qiang Yang, Xian-Sheng Hua
The Visual Computer, 25(1): 39-51, 2009.
Best Demo Award from SIGMM 2007

Video Collage is a kind of synthesized image that enable users to quickly browse the video content. Given a video, Video Collage is able to select the most representative images from the video, extract salient regions of interest (ROI) from these images, and seamlessly arrange ROI on a given canvas.

When Multimedia Advertising Meets the New Internet Era

Xian-Sheng Hua, Tao Mei, Shipeng Li
IEEE Workshop on Multimedia Signal Processing, 2008.
Best Poster Award from MMSP 2008

Conventional ad-networks treat image and video advertising as general text advertising, while in MediaSense, we summarize the trends of online advertising and propose an innovative advertising model driven by the compelling contents of images and videos.

Multi-Graph-Based Query-Independent Learning for Video Search

Yuan Liu, Tao Mei, Xiuqing Wu, Xian-Sheng Hua
IEEE Trans. on Circuits and Systems for Video Technology, 19(12): 1841-1850, 2009.

We propose a novel query-independent learning approach based on multi-graph to video search, which learns the relevance information existing in the query-shot pairs. The proposed approach is more general and suitable for a real-world video search system as the learned relevance is independent on any query and any dataset.

CrowdReranking: Exploring Multiple Search Engines for Visual Search Reranking

Yuan Liu, Tao Mei, Xian-Sheng Hua
ACM SIGIR, 2009.

CrowdReranking is a new method for visual search reranking, which is characterized by mining relevant visual patterns from image search results of multiple search engines which are available on the Internet.

Coherent Image Annotation by Learning Semantic Distance

Tao Mei, Yong Wang, Xian-Sheng Hua, Shaogang Gong, Shipeng Li
IEEE CVPR, 2008.

We propose a novel approach to image annotation which learns a Semantic Distance by capturing the prior annotation knowledge and propagates the annotation of an image as a whole entity.

Multi-Layer Multi-Instance Learning for Video Concept Detection

Zhiwei Gu, Tao Mei, Xian-Sheng Hua, et al.
IEEE Trans. on Multimedia, 10(8): 1605-1616, 2008.

Video is essentially a kind of media with multi-layer (ML) structure. We call such multi-layer structure and the "bag-instance" relations embedded in the structure as Multi-Layer Multi-Instance (MLMI) setting.

Structure and Event Mining in Sports Video with Efficient Mosaic

Tao Mei, Xian-Sheng Hua
Multimedia Tools and Applications, 40(1): 89-110, 2008.

We propose a mosaic based approach to key-event as well as structure mining for sports video analysis. Mosaic is generated for each shot by a novel efficient mosaicing scheme. Based on mosaic, the structure and event in sports video are mined by the methods with prior knowledge and without prior knowledge.

Professional Activities

Associate Editor | Guest Editor

Journal of Multimedia (Academy, 2009-)
Neurocomputing (Elsevier, 2010-)
Guest Editor of IEEE Multimedia for the Special Issue on "Knowledge Discovery over Community-Contributed Multimedia Data: Opportunities and Challenges," 2010.
Guest Editor of Elsevier Journal of Visual Communication and Image Representation for the Special Issue on "Large-Scale Image and Video Search: Challenges, Technologies, and Trends," 2009.
Guest Editor of ACM/Springer Multimedia Systems Journal for the Special Issue on "Multimedia Intelligent Services and Technologies," 2009.

Special Session Organizer

VCIP 2010. "Interactive Multimedia Analysis." Co-organized with Prof. Ling Shao, Prof. Dacheng Tao, and Prof. Zengfu Wang.
ICME 2009. "Knowledge Discovery over Community-Sharing Media - from Signal to Intelligence." Co-organized with Prof. Winston Hsu and Dr. Rong Yan.
MMSP 2008. "Search and Beyond Search: Online Multimedia Applications." Co-organized with Dr. Xian-Sheng Hua, Dr. Lingyu Duan, and Prof. Jesse Jin.

Organization Committee Member

International MultiMedia Modeling Conference (MMM), Special Session Co-chair, Chongqing, China, 2010.

Selected Technical Program Committee Member

ACM Intl Conference on Multimedia (ACM MM), Meta TPC Member, Application Track, 2010.
ACM Conference on Research and Development in Information Retrieval (SIGIR), 2010.
ACM International Conference on Image and Video Retrieval (CIVR), 2010.
IEEE International Conference on Multimedia & Expo (ICME), 2010.
International Conference on Pattern Recognition (ICPR), 2010.
International MultiMedia Modeling Conference (MMM), 2010.
International Conference on Visual Communications and Image Processing (VCIP), 2010.
Pacific-Rim Conference on Multimedia (PCM), 2010.
Pacific-Asia Conference on Knowledge Discovery and Data Mining (PAKDD), 2010.

[Year 2009]
ACM International Conference on Multimedia (ACM MM), Application Track, 2009.
ACM Conference on Research and Development in Information Retrieval (SIGIR), 2009.
ACM Intl Conference on Internet Multimedia Computing and Service (ICIMCS), 2009.
IEEE International Conference on Multimedia & Expo (ICME), 2009.
International MultiMedia Modeling Conference (MMM), 2009.
Pacific-Rim Conference on Multimedia (PCM), 2009.
Pacific-Asia Conference on Knowledge Discovery and Data Mining (PAKDD), 2009.
IEEE Workshop on Emergent Issues in Large Amounts of Visual Data, with ICCV, 2009.

[Year 2008]
IEEE International Workshop on Multimedia Signal Processing (MMSP), 2008.
IEEE International Symposium on Multimedia (ISM), 2008.
International MultiMedia Modeling Conference (MMM), 2008.
International Conference on Signal Processing and Multimedia Applications (SIGMAP), 2008.

[Year 2007]
Pacific-Rim Conference on Multimedia (PCM), 2007.

Session Chairs

"Image Retrieval," International MultiMedia Modeling Conference (MMM), 2010.
"Information Summarization," ACM International Conference on Multimedia (ACM MM), 2009.
"Poster Session," International MultiMedia Modeling Conference (MMM), 2009.
"Media Retrieval," International MultiMedia Modeling Conference (MMM), 2008.

Reviewer

ACM Computing Surveys
ACM Transactions on Multimedia Computing, Communications, and Applications
ACM Transactions on Information Systems
ACM Multimedia Systems
IEEE Multimedia Magazine
IEEE Trans. on Pattern Analysis and Machine Intelligence
IEEE Trans. on Image Processing
IEEE Trans. on Circuits and Systems for Video Technology
IEEE Trans. on Multimedia
IEEE Trans. on Knowledge and Data Engineering
IEEE Trans. on Systems, Man and Cybernetics - Part B
IEEE Signal Processing Letters
Elsevier Pattern Recognition
Elsevier Pattern Recognition Letters
Elsevier Information Sciences
Elsevier Signal Processing
Elsevier Neurocomputing
Elsevier Computer Vision and Image Understanding
Elsevier Journal of Visual Communication and Image Representation
Springer Multimedia Tools and Applications
Springer Machine Vision and Applications

Awards

Best Paper Award, The 17th International ACM Conference on Multimedia, ACM SIGMM, 2009.
Best Poster Paper Award, The IEEE International Workshop on Multimedia Signal Processing, IEEE MMSP, 2008.
Best Paper Award, The 15th International ACM Conference on Multimedia, ACM SIGMM, 2007.
Best Demo Award, The 15th International ACM Conference on Multimedia, ACM SIGMM, 2007.
President Scholarship of the Chinese Academy of Sciences, 2006.
Microsoft Fellowship Award (18/Asia), Microsoft Research Asia, 2002.
Guanghua Scholarship, University of Science and Technology of China, 2001.

The interns I mentored at MSR Asia


Zhiwei Gu (USTC \| MSRA)	Lin Ma (PKU \| Startup)	Bo Yang (THU \| USC)	Tang Wang (USTC \| UM)	Zheng-Jun Zha (USTC \| NUS)	Yong Wang (QMUL \| Alibaba)	Yuan Liu (USTC \| RICOH)	Xueliang Liu (USTC \| Eurecom)	Kuiyuan Yang (USTC)	Xinyuan Fu (DLUT \| MS)


Qirong Ma (USTC \| UW)	Emily Moxley (UCSB \| Google)	Lvsong Li (BUAA)	Teng Li (KAIST \| CAS)	Weiyu Zhang (THU \| UPenn)	Tian Xia (ICT)	Jinlian Guo (USTC)	Fei Sheng (THU)	Lu Zhang (USTC)	Linxie Tang (USTC)


Ming-Fang Weng (NTU)	Yan Wang (USTC)	Han Lin (NTU)	Meiyuan Ding (THU)	Paul (UNSW)

Last Updated: Jan. 2010, Since July 14th, 2006.