Lie LU received his MS and BS from Shanghai Jiao Tong University, China, both in Electrical Engineering, in 2000 and 1997, respectively.  He is currently pursuing Ph.D degree from Delft University of Technology, The Netherlands.  

Since 2000, he has been with Microsoft Research Asia, Beijing, where he is currently a Researcher with Speech Group.  His current research interests include pattern recognition, content-based audio analysis and indexing, and content-based music analysis.  He has authored or co-authored around 50 publications in these areas and has 15 patents or pending applications.

He is a member of IEEE and ACM. He also served as a member of technical program committee for several international conferences, such as IEEE International Conference on Multimedia and Expo 2004 and 2007, and ACM Multimedia 2007.

Professional Activity

 ‒    TPC member, Asia Information Retrieval Symposium (AIRS ) 2008, Harbin, China

 ‒    TPC member, Pacific-Rim Conference on Multimedia (PCM) 2007, Hong Kong

 ‒    TPC member, ACM Multimedia 2007, Augsburg, Germany

 ‒    TPC member, IEEE International Conference on Multimedia and Expo 2007, Beijing, China

 ‒    TPC member, IJCAI Workshop on Multimodal Information Retrieval 2007, Hyderabad, India

 ‒    TPC member, IEEE International Conference on Multimedia and Expo 2004, Taipei, Taiwan

 ‒    Session chair, IEEE International Conference on Multimedia and Expo 2001, Tokyo, Japan

 ‒    IEEE member and ACM member

Projects

 ‒    Audio Content Analysis  

       +    Audio Segmentation and Classification

       +    Speaker Segmentation and Tracking

       +    Semantic Segmentation

       +    Audio Similarity Measure (Temporal and Spectral Feature Structure Pattern)

       +    Audio Key Effects Detection and Semantic Event Inference

       +    Unsupervised Content Discovery of Composite Audio

       +    Audio Thumbnails

       +    Audio Document Similarity Measure

 ‒    Music Content Analysis  

       +    Music Steering

       +    Music Recommendation

       +    Music Classification

       +    Beat Tracking

       +    Mood Detection

       +    Music Snippet (Music Thumbnail)

       +    Music Repeating Pattern Detection and Music Structuring

       +    Music Collection Visualization

 ‒    Music Retrieval by humming 

 ‒    Web Music Mining 

 ‒    Audio Textures 

 ‒    Audio Attention Model 

Detailed Projects Descriptions >>>

Selected Journal Papers

[1] Lie Lu, and Alan Hanjalic."Audio Keywords Discovery for Text-Like Audio Content Analysis and Retrieval", to appear IEEE Trans. on Multimedia, 2007-2008

[2] Xian-Sheng Hua, Lie Lu and Hong-Jiang Zhang. "Photo2Video - A System for Automatically Converting Photographic Series into Video".  IEEE Trans. on Circuits and Systems for Video Technology, Vol. 16, No.7, 803-819, 2006.

[3] Rui Cai, Lie Lu, Alan Hanjalic, Hong-Jiang Zhang, and Lian-Hong Cai.  "A Flexible Framework for Key Audio Effects Detection and Auditory Context Inference", IEEE Trans. on Audio, Speech and Language Processing, Vol. 14,  No.3, 1026-1039, May 2006

[4] Lie Lu, Dan Liu, Hong-Jiang Zhang.  "Automatic Mood Detection and Tracking of Music Audio Signals", Special Issue on Statistical and Perceptual Audio Processing, IEEE Trans. on Audio, Speech and Language Processing, Vol. 14, No. 1, 5-18, Jan. 2006

[5] Lie Lu, Hong-Jiang Zhang. "Unsupervised Speaker Segmentation and Tracking in Real-Time Audio Content Analysis", ACM/Springer Multimedia Systems Journal 10 (4), pp. 2005.

[6] Yu-Fei Ma, Xian-Sheng Hua, Lie Lu, Hong-Jiang Zhang.  "User Attention Model based Video Summarization",  IEEE Trans. on Multimedia, Vol.7, No. 5, 907-919, 2005

[7] Xian-Sheng Hua, Lie Lu, Hong-Jiang Zhang. "Optimization-Based Automated Home Video Editing System", Special Issue on Audio and Video Analysis for Multimedia Interactive Services, IEEE Trans.on Circuits and Systems for Video Technology, Vol. 14, No.5, pp.572-583, May, 2004

[8] Lie Lu, Liu Wenyin, Hong-Jiang Zhang. "Audio Textures: Theory and Applications", IEEE Trans. on Speech and Audio Processing, Vol.12, No. 2, pp.156-167, March 2004

[9] Lie Lu, Hong-Jiang Zhang, Stan Li, "Content-based Audio Classification and Segmentation by Using Support Vector Machines", ACM Multimedia Systems Journal 8 (6), pp. 482-492, 2003.

[10] Lie Lu, Hong-Jiang Zhang, Hao Jiang, "Content Analysis for Audio Classification and Segmentation", IEEE Trans.on Speech and Audio Processing, Vol.10, No.7, pp.504-516, Oct. 2002.

Complete Publications List >>>