| Representative Publications
[full
list by year] [full
list by categories] [DBLP] |
| |
|
|
|
Contextual
In-Image Advertising
Tao Mei, Xian-Sheng Hua, Shipeng Li
ACM Multimedia, pp. 439-448, 2008. |
|
ImageSense is an innovative
contextual advertising system driven by images, which automatically associates
relevant ads with an image rather than the entire text in a Web page and
seamlessly inserts the ads in the nonintrusive areas within each individual
image. ImageSense represents the first attempt towards contextual in-image
advertising. |
|
|
|
VideoSense
- Towards Effective Online Video Advertising
Tao Mei, Xian-Sheng Hua, Linjun Yang, Shipeng
Li
ACM Multimedia, pp. 1075-1084, 2007. |
|
VideoSense is a novel
advertising system for online video service, which automatically associates
the most relevant video ads with videos and seamlessly inserts the ads at
the most appropriate positions within each video. Unlike most current video
sites that only display a video ad at the beginning or the end of a video,
VideoSense aims to embed more contextually relevant ads at less intrusive
positions within video stream. |
|
|
|
Video
Collage: Presenting a Video Sequence Using a Single Image
Tao Mei, Bo Yang, Shi-Qiang Yang, Xian-Sheng
Hua
The Visual Computer, 25(1): 39-51, 2009.
Best Demo Award from SIGMM 2007 |
|
Video Collage is a kind
of synthesized image that enable users to quickly browse the video content.
Given a video, Video Collage is able to select the most representative images
from the video, extract salient regions of interest (ROI) from these images,
and seamlessly arrange ROI on a given canvas. |
|
|
|
When
Multimedia Advertising Meets the New Internet Era
Xian-Sheng Hua, Tao Mei, Shipeng Li
IEEE Workshop on Multimedia Signal Processing, pp. 1-5, 2008.
Best Poster Award from MMSP 2008 |
|
The community-contributed media
contents have become the primary sources for online advertising. Conventional
ad-networks treat image and video advertising as general text advertising,
while in MediaSense, we summarize the trends of online advertising
and propose an innovative advertising model driven by the compelling contents
of images and videos. We envision that the next trend of multimedia advertising
would be game-like advertising. |
|
|
|
Multi-Graph-Based
Query-Independent Learning for Video Search
Yuan Liu, Tao Mei, Xiuqing Wu, Xian-Sheng
Hua
IEEE Trans. on Circuits and Systems for Video Technology, 2009. |
|
We propose a novel query-independent
learning approach based on multi-graph to video search, which learns
the relevance information existing in the query-shot pairs. The proposed
approach, named MG-QIL, is more general and suitable for a real-world video
search system as the learned relevance is independent on any query and any
dataset. |
|
|
|
CrowdReranking: Exploring
Multiple Search Engines for Visual Search Reranking
Yuan Liu, Tao Mei, Xian-Sheng Hua
ACM SIGIR, 2009. |
|
CrowdReranking is a
new method for visual search reranking, which is characterized by mining
relevant visual patterns from image search results of multiple search engines
which are available on the Internet. Observing that diffrent search engines
might have diffrent data sources for indexing and methods for ranking, it
is reasonable to assume that there exist diffrent search results yet certain
common visual patterns relevant to a query among those results. |
|
|
|
VideoReach:
An Online Video Recommendation System
Tao Mei, Bo Yang, Xian-Sheng Hua, Linjun
Yang, Shi-Qiang Yang, Shipeng Li
ACM SIGIR, pp. 767-768, 2007 |
|
VideoReach is a novel
online video recommendation system, which alleviates users' efforts on finding
the most relevant videos according to current viewings without a sufficient
collection of user profiles as required in traditional recommenders. In
this system, video recommendation is formulated as finding a list of relevant
videos in terms of multimodal relevance and user click-through. |
|
|
|
Coherent
Image Annotation by Learning Semantic Distance
Tao Mei, Yong Wang, Xian-Sheng Hua, Shaogang
Gong, Shipeng Li
IEEE CVPR, 2008. |
|
We propose a novel approach
to image annotation which learns a Semantic Distance by capturing
the prior annotation knowledge and propagates the annotation of an image
as a whole entity. A semantic distance function (SDF) is learned for each
semantic cluster based on comparison relations of prior annotations. The
training images in each cluster are ranked according to their SDF values
and their annotations are then propagated as a whole entity to a new image. |
|
|
|
Multi-Layer
Multi-Instance Learning for Video Concept Detection
Zhiwei Gu, Tao Mei, Xian-Sheng Hua,
et al.
IEEE Trans. on Multimedia, 10(8): 1605-1616, 2008. |
|
Video is essentially a kind
of media with multi-layer (ML) structure. We call such multi-layer structure
and the "bag-instance" relations embedded in the structure as
Multi-Layer Multi-Instance (MLMI) setting. We systematically study
both ML structure and MI relations embedded in video content and formulate
video concept detection as a MLMI learning problem. |
|
|
|
Structure
and Event Mining in Sports Video with Efficient Mosaic
Tao Mei, Xian-Sheng Hua
Multimedia Tools and Applications, 40(1): 89-110, 2008.
|
|
We propose a mosaic based
approach to key-event as well as structure mining for sports video analysis.
Mosaic is generated for each shot by a novel efficient mosaicing
scheme, which constructs a global motion path and selects a best subset
of frames for mosaicing. Based on mosaic, the structure and event in sports
video are mined by the methods with prior knowledge and without prior knowledge. |
| |
|
Professional
Activities
Associate Editor | Editorial Board Member
Special Session Organizer
Organization Committee Member
Technical Program Committee Member
- ACM International Conference on Multimedia (ACM Multimedia). Application
track, Beijing, China, 2009.
- ACM SIGIR Conference on Research and Development in Information Retrieval
(SIGIR). Boston, USA, 2009.
- IEEE International Conference on Multimedia & Expo
(ICME). Cancun, Mexico, 2009.
- ACM International
Workshop on Interactive Multimedia for Consumer Electronics, with ACM
MM. Beijing, China, 2009.
- The First Intl Conference on Internet Multimedia
Computing and Service (ICIMCS). Kunmin, China, 2009.
- IEEE Workshop on Emergent Issues in Large Amounts
of Visual Data, in conjunction with ICCV (WS-LAVD). Kyoto, Japan, 2009.
- International Workshop on Internet
Multimedia Search and Mining, with ICME, 2009.
- International Workshop on Video Event
Categorization, Tagging and Retrieval, with ACCV, 2009.
- International MultiMedia Modeling Conference (MMM).
Kyoto, Japan, 2008; Sophia Antipolis, France, 2009; Chongqing, China,
2010.
- Pacific-Rim Conference on Multimedia (PCM). Hongkong,
China, 2007; Bangkok, Thailand, 2009.
- International Workshop
on Multimedia Signal Processing (MMSP). Cairns, Queensland, Australia,
2008.
- The IEEE International Symposium on Multimedia
(ISM). Berkeley, California, USA, 2008.
- IADIS International Conference Visual Communication
(VC). Amsterdam, Netherlands, 2008; Algarve, Portugal, 2009.
- International Conference
on Signal Processing and Multimedia Applications (SIGMAP). Porto, Portugal,
2008; Milan, Italy, 2009.
- International Conference on Image and Graphics
(ICIG). Xi'an, China, 2009.
- Pacific-Asia Conference on Knowledge Discovery
and Data Mining (PAKDD). Bangkok, Thailand, 2009.
- Pacific-Rim Symposium
on Image and Video Technology (PSIVT). Tokyo, Japan, Jan. 2009.
- Asia-Pacific Workshop
on Visual Information Processing (VIP). Southern Taiwan University,
Taiwan, Dec. 2008.
- International Workshop
on Video Mining (VM). in association with ICDM, Pisa, Italy, 2008.
Review for:
- ACM Computing Surveys, from 2007.
- ACM Transactions on Multimedia Computing,
Communications, and Applications, from 2008.
- ACM Multimedia Systems, from 2008.
- IEEE Multimedia, from 2009.
- IEEE Trans. on Pattern
Analysis and Machine Intelligence: Special Issue on Real-world
Image Annotation and Retrieval, 2007.
- IEEE Trans. on Image Processing, from 2008.
- IEEE Trans. on Multimedia, from 2007.
- IEEE Trans. on Circuits
and Systems for Video Technology, from 2006.
- IEEE Trans. Knowledge and Data Engineering, from 2008.
- IEEE Trans. Systems, Man and Cybernetics, Part B, from 2009.
- Pattern Recognition, from 2007.
- Pattern Recognition Letters, from 2007.
- Multimedia Tools and Applications, from 2007.
- Computer Vision and Image
Understanding: Special Issue on Similarity Matching in Computer Vision
and Multimedia
, 2006.
- Journal of Visual Communication
and Image Representation, from 2008.
- Machine Vision and Applications, from 2008.
- IPSJ Transactions on Computer
Vision and Applications, from 2008.
- Data Knowledge Engineering, from 2008.
- Neurocomputing, from 2008.
- Conferences: SIGIR 2009;
ICME 2009, 2008; PAKDD 2009; ICASSP 2009; ACM MM 2009, 2008; ACCV 2009;
SIGGRAPHASIA 2009; CIVR 2008, 2007; MMM 2009, 2008, 2006; SMC 2008;
PCM 2009, 2007, 2006, 2005; ICIP 2009, 2005; etc.
Awards
- Best poster award, The
IEEE International Workshop on Multimedia Signal Processing, IEEE MMSP,
2008.
- Best paper award, The
15th International ACM Conference on Multimedia, ACM SIGMM, 2007.
- Best demo award, The 15th
International ACM Conference on Multimedia, ACM SIGMM, 2007.
- President Scholarship of the Chinese Academy of
Sciences, 2006.
- Microsoft Fellowship Award
(18/Asia), Microsoft Research Asia, 2002.
- Guanghua Scholarship, University of Science and Technology of China,
2001.
The
interns I mentored at MSR Asia
|
|
|
|
|
|
|
|
|
|
|
|
Zhiwei Gu
(USTC | MSRA)
|
Lin Ma
(PKU | Startup)
|
|
Tang Wang
(USTC | UM)
|
Zheng-Jun Zha
(USTC | NUS)
|
Yong Wang
(QMUL | Alibaba)
|
Yuan Liu
(USTC | RICOH)
|
Xueliang Liu
(USTC)
|
Kuiyuan Yang
(USTC)
|
Xinyuan Fu
(DLUT | MS)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Qirong Ma
(USTC | UW)
|
|
Lvsong Li
(BUAA)
|
|
Weiyu Zhang
(THU | UPenn)
|
Tian Xia
(ICT)
|
|
Fei Sheng
(THU)
|
Lu Zhang
(USTC)
|
Linxie Tang
(USTC)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Yan Wang
(USTC)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
|
