Zicheng Liu

 

 

 

 

 

 

Email

Address
.
.

Phone

Fax

zliu@microsoft.com

Microsoft Research
One Microsoft Way
Redmond WA 98052

(425) 703-9662

(425) 936-7329

Researcher 
Microsoft Research

office

Building 113/2116


Zicheng Liu received his Ph.D. in computer science from Princeton University in 1996 . He got his B.S. degree in mathematics from HuaZhong Normal University, Wuhan, China, in 1984, and M.S. in operation research from the Institute of Applied Mathematics, Chinese Academy of Sciences, in 1989. Before joining Microsoft Research, he worked at Silicon Graphics Inc as a member of technical staff for two years where he developed the trimmed NURBS tessellator which was shipped in both OpenGL and the OpenGL Optimizer. His current research interests include 3D face modeling, facial expression mapping, face relighting, image segmentation, object/event detection and recognition, multimedia signal processing, and human interactive proofs (HIPs). He has worked on a variety of topics including Steiner trees, average case complexity, linked figure animation, and trimmed NURBS tessellation for large CAD model visualization. He was the co-chair of the IEEE International Workshop on Multimedia Technologies in E-Learning and Collaboration (Oct. 17, 2003, Nice, France).  He is the program co-chair of 2006 IEEE International Workshop on Multimedia Signal Processing (MMSP-06), Victoria, Canada. He is the media co-chair of 2007 International Conference on Multimedia and Expo (ICME07), Beijing, China. He has served in the technical committee for many international conferences. He is a member of the Audio and Electroacoustics Committee of IEEE Signal Processing Society. He is an associate editor of Machine Vision and Applications.  He is a senior member of IEEE.

Click here for a complete list of publications

Face Relighting

Face Relighting from a Single Image under Arbitrary Unknown Lighting Conditions, Yang Wang, Lei Zhang, Zicheng Liu, Gang Hua, Zhen Wen, Zhengyou Zhang, Dimitris Samaras, IEEE Transaction on Pattern Analysis and Machine Intelligence (TPAMI), accepted.

Face Relighting from a Single Image under Harsh Lighting Conditions, Yang Wang, Zicheng Liu, Gang Hua, Zhen Wen, Zhengyou Zhang, Dimitris Samaras, 2007 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2007), Minneapolis, June 18-23.

Face Relighting with Radiance Environment Maps. Zhen Wen, Zicheng Liu, Thomas S. Huang. 2003 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2003), Madison, Wisconsin, July. 26-27. , Page 158-165.

Object/Event Detection and Recognition

Expandable Data-Driven Graphical Modeling of Human Actions Based on Salient Postures, Wanqing Li, Zhengyou Zhang, Zicheng Liu, IEEE Transaction on Circuit and Systems for Video Technology (TCSVT), accepted.

A Deformable Local Image Descriptor , Hong Cheng, Zicheng Liu, Nanning Zheng, Jie Yang, 2008 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2008), Anchorage, Alaska, June 24-26, 2008.

Meta-tag Propagation by Co-training an Ensemble Classifier for Improving Image Search Relevance , Aayush Sharma, Gang Hua, Zicheng Liu, Zhengyou Zhang, First International Workshop on Internet Vision (in conjunction with CVPR), Anchorage, Alaska, June 23, 2008.

Iterative local-global energy minimization for automatic extraction of objects of interest, Gang Hua, Zicheng Liu, Zhengyou Zhang, Ying Wu, IEEE Transaction on Pattern Analysis and Machine Intelligence (TPAMI), Vol. 28, No. 10, October, 2006.

Automatic business card scanning with a camera, Gang Hua, Zicheng Liu, Zhengyou Zhang, Ying Wu, ICIP 2006, Atlanta, Oct. 8-11.

Distributed Microphone Arrays, Speech Processing with Sensor Arrays

SOUND SOURCE SEPARATION WITH DISTRIBUTED MICROPHONE ARRAYS IN THE PRESENCE OF CLOCK SYNCHRONIZATION ERRORS, Zicheng Liu, 2008 International Workshop for Acoustic Echo and Noise Control (IWAENC 2008), Sep. 14-17, Seattle.

BLIND SOURCE SEPARATION IN A DISTRIBUTED MICROPHONE MEETING ENVIRONMENT FOR IMPROVED TELECONFERENCING  , Jacek P. Dmochowski, Zicheng Liu, Phil Chou, 2008 International conference on Acoustics, Speech, and Signal Processing (ICASSP08) ,  Les Vegas, March 30 - April 4, 2008.

ENERGY-BASED POSITION ESTIMATION OF MICROPHONES AND SPEAKERS FOR AD HOC MICROPHONE ARRAYS  , Minghua Chen, Zicheng Liu, Li-Wei He, Phil Chou, Zhengyou Zhang, 2007 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA 07),  New Paltz, NY, October 21-24, 2007.

ENERGY-BASED SOUND SOURCE LOCALIZATION AND GAIN NORMALIZATION FOR AD HOC MICROPHONE ARRAYS  , Zicheng Liu, Zhengyou Zhang, Li-Wei He, Phil Chou, ICASSP07, Hawaii, April 15-20, 2007.

Multisensory processing for speech enhancement and magnitude-normalized spectra for speech modeling Speech Modeling with Magnitude-Normalized Complex Spectra and its Application to Multisensory Speech Enhancement, Amar Aubramanya, Zhengyou Zhang, Zicheng Liu, Alex Acero, Speech Communication 50 (2008) pp 228-243.

Speech Modeling with Magnitude-Normalized Complex Spectra and its Application to Multisensory Speech Enhancement, Amar Aubramanya, Zhengyou Zhang, Zicheng Liu, Alex Acero, ICME 2006.

A COMPACT MULTI-SENSOR HEADSET FOR HANDS-FREE COMMUNICATION. Zicheng Liu, Michael L. Seltzer, Alex Acero, Ivan Tashev, Zhengyou Zhang, and Mike Sinclair, IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA 05), New Paltz,  NY, Oct. 16-19, 2005. Audio Samples

A graphical model for multi-sensory speech processing in air-and-bone conductive microphones , Zhengyou Zhang, Amar Aubramanya, Zicheng Liu, Alex Acero, Jasha Droppo, Eurospeech 2005

MULTI-SENSORY SPEECH PROCESSING: INCORPORATING AUTOMATICALLY EXTRACTED HIDDEN DYNAMIC INFORMATION. Amarnag Subramanya,Li Deng, Zicheng Liu, and Zhengyou Zhang, ICME 2005, Amsterdam, July 5-9, 2005.

Leakage Model and Teeth Clack Removal for Air- and Bone-Conductive Integrated Microphones. Zicheng Liu, Amar Subramanya, Zhengyou Zhang, Jasha Droppo, Alex Acero, ICASSP 2005, Philadelphia, March 18-24, 2005.

Direct Filtering for Air- and Bone-Conductive Microphones. Zicheng Liu, Zhengyou Zhang , Alex Acero , Jasha Droppo , Xuedong Huang MMSP 2004, Italy, Sep29-Oct1, 2004. Audio Samples

Nonlinear Information Fusion for Multi-Sensor Speech Recognition -- Estraction and Exploiting Hidden Dynamics for Speech Captured by a Bone-Conductive Microphone. Li Deng, Zicheng Liu, Zhengyou Zhang, Alex Acero, MMSP 2004, Italy, Sep29-Oct1, 2004.

Multi-sensory Microphones for Robust Speech Detection, Enhancement, and Recognition. Zhengyou Zhang,Zicheng Liu, Mike Sinclair, Alex Acero, Li Deng, Jasha Droppo, Xuedong Huang, Yanli Zheng. ICASSP 2004, Montreal, May 17-21, 2004.

  Air-And Bone-Conductive Integrated Microphones for Robust Speech Detection and Enhancement. Yanli Zheng, Zicheng Liu, Zhengyou Zhang, Mike Sinclair, Jasha Droppo, Li Deng, Alex Acero,  Xuedong Huang. ASRU 2003, St. Thomas, U.S. Virgin Islands, Nov. 30 - Dec. 4, 2003.

Facial Expression Mapping and Image-Based Bump Mapping

Generic Framework for Efficient 2D and 3D Facial Expression Analogy,  Mingli Song, Zhao Dong, Christian Theobalt, Huiqiong Wang, Zicheng Liu, Hans-Peter Seidel, IEEE Transaction on Multimedia (TMM), Vol. 9, No. 7, 2007.

Subtle Facial Expression Modeling with Vector Field Decomposition, Mingli Song, Huiqiong Wang, Jiajun Bu, Chun Chen, Zicheng Liu, ICIP 2006, Atlanta, Oct. 8-11.

Real-Time Facial Expression Mapping for High Resolution 3D Meshes, Mingli Song, Zicheng Liu, Baining Guo, Computer Graphics International (CGI) 2006.

Geometry-Driven Photorealistic Facial Expression Synthesis,  Qingshan Zhang, Zicheng Liu, Baining Guo, Demetri Terzopoulos, Heung-Yeung Shum, IEEE Transactions on Visualization and Computer Graphics (TVCG), Vol. 12, No.1, 2006.

Image-Based Surface Detail Transfer.  Zicheng Liu, Ying Shan, Zhengyou Zhang, IEEE Computer Graphics and Applications, Vol. 24, No.3, 2004, Page 30-35.

Geometry-Driven Photorealistic Facial Expression Synthesis. Qingshan Zhang, Zicheng Liu, Baining Guo, Harry Shum. SCA 2003, San Diego, California, June. 16-22. 

Expressive Expression Mapping with Ratio Images. Zicheng Liu, Ying Shan, Zhengyou Zhang. SIGGRAPH 2001, Los Angeles, August 12-17. Page 271-276  The color plate has a few cool examples.

Image-Based Surface Detail Transfer. Ying Shan, Zicheng Liu, Zhengyou Zhang. CVPR 2001, Hawaii, Dec. 11-13.  Vol II, Page 794-799.

Face Modeling:

A Fully Automatic System to Model Faces From a Single Image. Zicheng Liu, MSR Tech Report, MSR-TR-2003-55.

Model-Based Bundle Adjustment with Application to Face Modeling. Ying Shan, Zicheng Liu, Zhengyou Zhang. ICCV 2001,Vol II, Page 644-651.

Rapid Modeling of Animated Faces From Video. Zicheng Liu, Zhengyou Zhang, Chuck Jacobs, Michael Cohen.  Journal of Visualization and Computer Animation, Vol 12, No.4 (Sep. 2001), Page 227-240. Also in MSR-TR-2000-11.

Robust and Rapid Generation of Animated Faces from Video Images: A Model-Based Modeling Approach. Zhengyou Zhang, Zicheng Liu, Dennis Adler, Michael Cohen, Erik Hanson, Ying Shan, International Journal of Computer Vision, Vol 58, No. 2. July 2004. Page 93-120.

Robust Head Motion Computation by Taking Advantage of Physical Properties. Zicheng Liu, Zhengyou Zhang. Proceedings of HUMO2000 (IEEE Workshop on Human Motion), page 73-77.

There is an internal web site for FaceModeling project.

Multimedia Collaboration

Semantic Saliency Driven Camera Control for Personal Remote Collaboration Cha Zhang, Zicheng Liu, Zhengyou Zhang, and Qi Zhao. IEEE International Workshop on Multimedia Signal Processing (MMSP), October, 2008, Queensland, Australia.

Learning-Based Perceptual Image Quality Improvement for Video Conferencing, Zicheng Liu, Cha Zhang, Zhengyou Zhang, IEEE International Conference on Multimedia and Expo (ICME), July, 2007, Beijing, China.

Head-size equalization for improved visual perception in Video Conferencing . Zicheng Liu, Michael Cohen, Deepti Bhatnagar, Ross Cutler, Zhengyou Zhang, IEEE Transaction on Multimedia (TMM), Vol. 9,  No. 7, (Nov., 2007).

Head-Size Equalization for Better Visual Perception of Video Conferencing . Zicheng Liu, Michael Cohen, IEEE International Conference on Multimedia and Expo (ICME), July, 2005, Amsterdam, The Netherlands.

Automatic Head-size Equalization in Panorama Images for Video Conferencing . Ya Chang, Ross Cutler, Zicheng Liu, Zhengyou Zhang, Alex Acero, IEEE International Conference on Multimedia and Expo (ICME), July, 2005, Amsterdam, The Netherlands. (Longer version with more details)

Low Bit-Rate Video Streaming for Face-To-Face Teleconference. Zhen Wen, Zicheng Liu, Michael Cohen, Jin Li, Ke Zheng, Thomas Huang,  ICME 2004.

Distributed Meetings: A Meeting Capture and Broadcasting System. Ross Cutler, Yong Rui,  Anoop Gupta, JJ Cadiz, Ivan Tashev, Li-Wei He, Alex Colburn, Zhengyou Zhang, Zicheng Liu, Steve Silverberg. ACM Multimedia 2002.

Why Take Notes? Use the Whiteboard Capture System. Li-Wei He, Zicheng Liu, Zhengyou Zhang. ICASSP 2003.

Real-Time Warps for Improved Wide-Angle Viewing. Zicheng Liu, Michael Cohen. MSR Technical Report TR-2002-110.

 

Human Interactive Proofs (HIPs)

Characters or Faces: A User Study on Easy of Use for HIPs . Yong Rui, Zicheng Liu, Shannon Kallin, Gavin Janke, Cem Paya. HIP 2005, Lecture Notes in Computer Science 3517, Henry S. Baird and Daniel P. Lopresti (eds.) pp53-65.

ARTiFACIAL: Automated Reverse Turing test Using FACIAL features. Yong Rui, Zicheng Liu, Multimedia Systems Journal , No. 9, 2004.

 

Media coverage:

CNET News: Microsoft Demos Robotic Receptionist

Red Herring Magazine by Niall McKay (4/5): Let's play with Microsoft

CBS Saturday Early Show with Renay San Miguel (4/21) : MPEG file (77 MB).

KOMO 4(ABC local news) (5/10): Low resolution(2.5MB), Higher Resolution (12MB).

Cool pictures and animations from my work on linked figure animation:

basketball players (MPEG,350K)

diving simulation (MPEG, 250K)

Click here to see pictures of his two kids Zachary and Alicia.

pictures taken at Victoria and Vancouver in 2001.


In September 2000, I  took a trip to the famous Yellow Mountain, which is located in Anhui, China. Click the following link for some nice pictures.

  Tour of the Yellow Mountain (Anhui, China):