The explosion of multimedia data brings us both challenges and opportunities. This research direction will use the massive data, as well as technologies in multimedia content analysis, machine learning, data mining and human-computer interface, to facilitate multimedia search on and across desktops, the Internet, and mobile devices. The incomplete research topics includes: large-scale video/image annotation/tagging, ranking/reranking, new multimedia HCI, accessible image search, etc.
Introduction
The rapid increase of multimedia data brings us new challenges to multimedia content understanding, organization, presentation and search especially in terms of scalability. Both computational costs and performance are still far from satisfactory with the increase of multimedia data and the increase of semantic demands. While on the other hand, these increasing data as well as the massive grassroots users also provides us new opportunities to attack these challenges as well as conventional problems in multimedia analysis and computer vision. This research direction will use all these information, as well as technologies in multimedia content analysis, machine learning, data mining and human-computer interface, to facilitate multimedia search on and across desktops, the Internet, and mobile devices.
Current Research Topics
Large-scale video/image annotation/tagging
Image and video search reranking
Image and video searchranking
Next generation multimedia query interface
Multimedia search result organization and presentation
Accessible multimedia search
Internet multimeida mining
Image/video copy/near-duplicate detection
Distance learning/mining
Tag processing (filtering, completion, ranking, recommendation, ...)
Contact Person
Xian-Sheng Hua (Lead Researcher, Internet Media Group, MSR Asia)
- Jingdong Wang, Xian-Sheng Hua, and Yinghai Zhao, Color-Structured Image Search, no. MSR-TR-2009-82, 6 July 2009
- Meng Wang, Linjun Yang, and Xian-Sheng Hua, MSRA-MM: Bridging Research and Industrial Societies for Multimedia Information Retrieval, no. MSR-TR-2009-30, 16 March 2009
- Lei Wu, Xian-Sheng Hua, Nenghai Yu, Wei-Ying Ma, and shipeng li, Flickr Distance, in Proceeding of ACM Multimedia 2008, Association for Computing Machinery, Inc., 28 October 2008
- Xian-Sheng Hua and Guo-Jun Qi, Online Multi-Label Active Learning for Large-Scale Multimedia Annotation, no. MSR-TR-2008-103, June 2008
- Zheng-Jun Zha, Yuan Liu, Tao Mei, and Xian-Sheng Hua, Video Concept Detection Using Support Vector Machines - TRECVID 2007 Evaluations, no. MSR-TR-2008-10, August 2007
- Jun Wu, Xian-Sheng Hua, Jian-Min LI, Bo Zhang, and Hong-Jiang Zhang, An Online Learning Framework for Sports Video View Classification, Springer-Verlag, November 2004
- Xian-Sheng Hua and Hong-Jiang Zhang, An Attention-Based Decision Fusion Scheme for Multimedia Information Retrieval, Springer-Verlag, November 2004
- Jun Wu, Xian-Sheng Hua, Hong-Jiang Zhang, and Bo Zhang, An Online-Optimized Incremental Learning Framework for Video Semantic Classification, Association for Computing Machinery, Inc., October 2004
