The rapid development of rich content, efficient coding and delivery technologies, user-friendly authoring software, easy to use media management applications, powerful search functions, and handy digital media devices is driving the adoption of digital media in our everyday lives. Finding innovative ways to improve and integrate all the components of this digital media ecosystem and deliver a seamless media experience is the goal of the Internet Media Group.
 

LiquidSilver: Seamless Media Framework

LiquidSilver is a media framework that works across both software platforms such as Windows XP and Windows Mobile and hardware platforms such as PCs, pocket PCs, smart phones, and gaming devices. The framework compresses media to be scalable for different devices and networks and includes components that facilitate media capturing, editing, authoring, coding, delivery, and management. Applications and templates within LiquidSilver help guide users as they create professional looking digital media and make authoring a snap. With this seamless media framework, media is organized for easy access and stored according to contents and meta-data associations.

Information and System Security

In a connected digital world, it is critical to safeguard the copyright of digital content such as multimedia and software, to protect a system from malicious attacks, to guarantee users’ privacy, and to ensure fairness in network-based transactions. We are creating new technologies to address these important issues. A partial list of our recent efforts includes:

• Multimedia encryption, key management, and digital rights management
• Fortified security for web applications
• Fair transactions and fraud detection
• Window-based system security and performance diagnosis

Content-Based Media Search, Management, Authoring, Sharing and Advertising

Developing content analysis technologies that assists users search, manage, capture, author, share, and enjoy media content is the main goal of this project. As a result of technologies developed through this project, a computer system can use content analysis to extract structures and semantics. This facilitates effective indexing and random access that enables efficient search, retrieval, and browsing of media. Other technologies being developed and researched as a part of this project include media segmentation and structuring, media browsing and visualization, event detection, semantic classification, intelligent annotation, quality assessment and adjustment, automatic and semi-automatic authoring, and relevance matching.

By integrating these technologies with other information contained within media, the Internet Media Group is delivering a systematic solution for less-effort digital media search, management, capturing, authoring, sharing and advertising across the Internet, desktop PCs, and mobile devices.

Primary Contact: Shipeng Li
FENG, Min	Hua, Xian-Sheng	Li, Shipeng	Photo Not Available Lu, Yan
Photo Not Available Mei, Tao	Pan, Aimin	Sun, Xiaoyan	Wu, Feng
Photo Not Available Xu, Ji-Zheng	Photo Not Available Yang, Linjun	Photo Not Available Zhou, You	Zhu, Bin
Affiliate Members
Cai, Hua	Chou, Philip A.	Li, Jiang	Lou, Jian-Guang
Luo, Chong	Shen, Jacky

• Feng Wu, Honghui Sun, Guobin Shen, Shipeng Li, Ya-Qin Zhang, Bruce Lin, Ming-Chieh Li, "SMART: an efficient, scalable and robust streaming video system", EURASIP on Applied Signal Processing, vol. 2, pp 192-206, 2004
• Lujun Yuan, Feng Wu, Qi Chen, Shipeng Li, Wen Gao,"The fast close-loop video transcoder with limited drifting error", IEEE International Symposium on Circuits and Systems (ISCAS), vol. 3, pp 769-772, 2004
• Alexis M. Tourapis, Feng Wu, Shipeng Li, "Direct mode coding for bi-predictive pictures in the H.264 standard", IEEE transaction on Circuits and Systems for Video Technology
• Wenpeng Ding, Feng Wu, Shipeng Li, "Lifting-based wavelet transform with directionally spatial prediction", PCS 2004.
• Lin Luo, Feng Wu, Shipeng Li, Zixiang Xiong, Zhenquan Zhuang, "Advanced motion threading for 3D wavelet video coding", Signal Processing: Image Communication, special issue on subband/wavelet video coding, 2004
• Ruiqin Xiong, Feng Wu, Shipeng Li, Zixiang Xiong, Ya-Qin Zhang, "Exploiting temporal correlation with adaptive block-size motion alignment for 3D wavelet coding", SPIE Visual Communications and Image Processing (VCIP), vol. 5308, pp 144-155, January 2004.
• Alexis M. Tourapis, Feng Wu, Shipeng Li, "Direct macroblock coding for predictive (P) pictures in the H.264 standard", SPIE Visual Communications and Image Processing (VCIP), vol. 5308, pp 364-371, January 2004
• Hua Cai, Bing Zeng, Guobin Shen, and Shipeng Li, "Error-Resilient Unequal Protection of Fine Granularity Scalable Video Bitstreams", Proc. of 2004 International Conference on Communications (ICC 2004), Paris, France, June 20-24, 2004.
• Lujun Yuan, Guobin Shen, Feng Wu, Shipeng Li, Wen Gao, "Color space compatible coding framework for YUV422 video coding", IEEE International conference on Acoustics, Speech and Signal Processing (ICASSP), vol. 3, pp 185-188, 2004
• Guobin Shen, Guang-ping Gao, Shipeng Li, Heung-Yeung Shum and Ya-Qin Zhang, "ACCELERATE VIDEO DECODING WITH GENERIC GPU", Accepted by IEEE-CSVT. To appear.
• Keman Yu, Jiang Li and Shipeng Li, "A Novel Approach to Real-time Multimedia Forwarding over Heterogeneous Networks", 2004 IEEE International Symposium on Circuits and Systems, 23-26 May 2004, Vancouver, Canada, pages 61-64.
• Cuizhu Shi, Keman Yu, Jiang Li and Shipeng Li, "Automatic Image Quality Improvement for Videoconferencing", 2004 International Conference on Acoustics, Speech, and Signal Processing, May 17-21, 2004, Montreal, Canada, pages III 701-704.
• Keman Yu, Shan Lu, Jiang Li and Shipeng Li, "Half-pixel Motion Estimation Bypass Based on a Linear Model", Picture Coding Symposium 2004, 15-17 December 2004, San Francisco, USA.
• Yu Chen, Keman Yu, Jiang Li and Shipeng Li, "An Error Concealment Algorithm for Entire Frame Loss in Video Transmission", Picture Coding Symposium 2004, 15-17 December 2004, San Francisco, USA.
• Jizheng Xu, Feng Wu and Shipeng Li, "Transcoding for progressive fine granularity scalable video coding", IEEE International Symposium on Circuits and Systems, Vancouver, Cannada. May 2004.
• Ruiqin Xiong, Jizheng Xu, Feng Wu, Shipeng Li, Ya-Qin Zhang, "Layered motion estimation and coding for fully scalable 3D wavelet video coding", International conference on image processing, Singapore. Oct, 2004.
• Bo Feng, Jizheng Xu, Feng Wu, Shiqiang Yang, Shipeng Li, "Energy distributed update steps (EDU) in lifting based motion compensated video coding", International conference on image processing, Singapore. Oct, 2004
• Xiangyang Ji, Jizheng Xu, Debin Zhao, Feng Wu, "Architectures of incorporating MPEG-4 AVC into three-dimensional wavelet video coding", Picture Coding Symposium, San Francisco, CA, USA, Dec 2004.
• Li Song, Jizheng Xu, Hongkai Xiong, Feng Wu, "Content adaptive update steps for lifting-based motion compensated temporal filtering", Picture Coding Symposium, San Francisco, CA, USA, Dec 2004.
• Ruiqin Xiong, Jizheng Xu, Feng Wu, Shipeng Li, Ya-Qin Zhang,  "Spatial scalability in 3D wavelet coding with spatial domain MCTF encoder",Picture Coding Symposium, San Francisco, CA, USA, Dec 2004.
• Ruiqin Xiong, Feng Wu, Jizheng Xu, Shipeng Li, Ya-Qin Zhang, "Barbell lifting wavelet transform for highly scalable video coding", Picture Coding Symposium, San Francisco, CA, USA, Dec 2004.
• Xian-Sheng HUA, Lie LU, and Hong-Jiang ZHANG, "Automatically Converting Photographic Series into Video", 12th ACM International Conference on Multimedia, New York City, USA, Oct. 2004.
• Xian-Sheng HUA, Lie LU, and Hong-Jiang ZHANG,  "Automatic Music Video Generation Based on Temporal Pattern Analysis", 12th ACM International Conference on Multimedia, New York City, USA, Oct. 2004.
• Jun WU, Xian-Sheng HUA, Hong-Jiang ZHANG and Bo ZHANG,  "An Online-Optimized Incremental Learning Framework for Video Semantic Classification", 12th ACM International Conference on Multimedia, New York City, USA, Oct. 2004.
• Xian-Sheng HUA, Lie LU, and Hong-Jiang ZHANG, "P-Karaoke: Personalized Karaoke System", 12th ACM International Conference on Multimedia, New York City, USA, Oct. 2004.
• Xian-Sheng HUA, Xian CHEN, Hong-Jiang ZHANG, "Robust Video Signature Based on Ordinal Measure",International Conference on Image Processing (ICIP 2004), October 24-27, Singapore, 2004.
• Xian-Sheng HUA, Hong-Jiang ZHANG, "Content and Transformation Effect Matching for Automated Home Video Editing", International Conference on Image Processing (ICIP 2004), October 24-27, Singapore, 2004.
• Xian-Sheng HUA, Hong-Jiang ZHANG,  "An Attention-Based Decision Fusion Scheme for Multimedia Information Retrieval", The Fifth Pacific-Rim Conference on Multimedia (PCM 2004), November 30-December 3, Tokyo, Japan, 2004.
• Liexian GU, Xiaoqing DING, Xian-Sheng HUA, "Online Play Segmentation for Broadcasted American Football TV Programs",The Fifth Pacific-Rim Conference on Multimedia (PCM 2004), November 30-December 3, Tokyo, Japan, 2004.
• Jun WU, Xian-Sheng HUA, Jian-Min LI, Bo ZHANG, Hong-Jiang ZHANG,  "An Online Learning Framework for Sports Video View Classification", The Fifth Pacific-Rim Conference on Multimedia (PCM 2004), November 30-December 3, Tokyo, Japan, 2004.
• Xian-Sheng HUA, Lie LU, Hong-Jiang ZHANG, "Optimization-Based Automated Home Video Editing System", IEEE Transactions on Circuits and Systems for Video Technology, May 2004, Vol 14, No. 5, pp 572-583, 2004.
• Xian-Sheng HUA, Liu Wenyin, Hong-Jiang ZHANG,  "An Automatic Performance Evaluation Protocol for Video Text Detection Algorithms", IEEE Transactions on Circuits and Systems for Video Technology, April 2004, Vol 14, No. 4, pp 498-507, 2004.
• You Zhou, Xiaoyan Sun, Shipeng Li, Hong Bao,  "Weighted Motion Estimation for Static Scene Transitions", IEEE International Conference on Speech, Acoustics, and Signal Processing, vol 3, pp361-364, 2004
• Xiaoyan Sun, Feng Wu, Shipeng Li, Wen Gao, Ya-Qin Zhang,  "Seamless switching of scalable video bitstreams for efficient streaming", IEEE transaction on multimedia, special issue on Video Streaming, vol. 6, no. 2, pp 291-303, 2004
• You Zhou, Xiaoyan Sun, Feng Wu, Hong Bao, Shipeng Li, "Flexible P-picture (FLEXP) coding for the efficient fine granular scalability (FGS)", International conference on image processing, 2004
• Jungong Han, Xiaoyan Sun, Feng Wu, Shipeng Li, Zhaoyang Lu,  "Variable block-size transform and entropy coding at the enhancement layer of FGS", International conference on image processing, 2004
• Dongjun Lan, Yu-Fei Ma, Hong-Jiang Zhang, "Multi-level Anchorperson Detection Using Multimodal Association", Proceeding of IAPR International Conference on Pattern Recognition, Cambridge, UK, Aug. 23-26, 2004.
• Fei Wang, Yu-Fei Ma, Hong-Jiang Zhang, Jin-Tao Li, "Dynamic Bayesian Network Based Event detection for Soccer Highlight Extraction", Proceeding of IEEE International Conference on Image Processing, Singapore, Oct. 24-27, 2004.
• Yu-Fei Ma, Xian-Sheng Hua, Lie Lu, Hong-Jiang Zhang, "User Attention Model based Video Summarization", to appear in IEEE Transactions on Multimedia

Contact Information:
Shipeng Li spli@microsoft.com