Publications by Zhengyou Zhang since 1998

(For publications before I joined MSR on March 31, 1998, click here.)

?COPYRIGHT NOTICE: All the documents on this server have been submitted by their authors to scholarly journals or conferences as indicated, for the purpose of non-commercial dissemination of scientific work. The manuscripts are put on-line to facilitate this purpose. These manuscripts are copyrighted by the authors or the journals in which they were published. You may copy a manuscript for scholarly, non-commercial purposes, such as research or instruction, provided that you agree to respect these copyrights.

?COPYRIGHT NOTICE FOR IEEE PUBLICATIONS: Copyright 1999 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works, must be obtained from the IEEE. Contact: Manager, Copyrights and Permissions / IEEE Service Center / 445 Hoes Lane / P.O. Box 1331 / Piscataway, NJ 08855-1331, USA. Telephone: +1-908-562-3966.

Special Issues

Z. Zhang, editor, Special Issue on Best of the Sixth sian Conference on Computer Vision, International Journal of Computer Vision, Vol. 66, No. 2, February 2006.

Z. Zhang, editor, Special Issue on Face Recognition and Video Analysis, International Journal of Pattern Recognition and Artificial Intelligence, Vol. 19, No. 4, June 2005.

Journal Articles and Book Chapters

Z. Zhang, and L. He, "Whiteboard Scanning and Image Enhancement",   Digital Signal Processing, Vol.17, No.2, pages 414-432, 2007.

L. He, and Z. Zhang, "Real-Time Whiteboard Capture and Processing Using a Video Camera for Remote Collaboration", IEEE Transactions on Multimedia, Vol.9, No.1, pages 198-206, 2007.

G. Hua, Z. Liu, Z. Zhang, and Y. Wu, "Iterative local-global energy minimization for automatic extraction of objects of interest", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.28, No.10, pages 1701-1706, 2006.

Z. Zhang, Z. Liu, R. Yang, "Model-based Face Modeling and Tracking With Application to Video Conferencing", in R. Chellappa and W. Zhao, eds, Face Processing: Advanced Modeling and Methods, Chapter 15, pp. 463-517, Academic Press, 2006.

Z. Zhang, "Camera Calibration", in G. Medioni and S.B. Kang, eds., Emerging Topics in Computer Vision, Chapter 2, pages 4-43, Prentice Hall Professional Technical Reference, 2004.

Z. Zhang, "Camera Calibration With One-Dimensional Objects'', IEEE Trans. Pattern Analysis and Machine Intelligence, 26(7):892-899, 2004.

R. Yang, and Z. Zhang, "Eye Gaze Correction With Stereovision for Video-Teleconferencing'', IEEE Trans. Pattern Analysis and Machine Intelligence, 26(7):956--960, 2004.

Z. Zhang, Z. Liu, D. Adler, M. F. Cohen, E. Hanson, and Y. Shan, "Robust and Rapid Generation of Animated Faces from Video Images: A Model-Based Modeling Approach'', International Journal of Computer Vision, 58(1):93-119, June 2004

Z. Liu, Z. Zhang, and Y. Shan, "Image-Based Surface Detail Transfer", IEEE Computer Graphics and Applications, 24(3):30-35, 2004.

C. Wu, C. Liu, H.-Y. Shum, Y.-Q. Xu, and Z. Zhang, "Automatic Eyeglasses Removal from Face Images'', IEEE Trans. Pattern Analysis and Machine Intelligence, 26(3):322-336, 2004.

Y. Shan and Z. Zhang. New Measurements and Corner-Guidance for Curve Matching With Probabilistic Relaxation. International Journal of Computer Vision, 46(2):157-171, 2002.

Z. Liu, Z. Zhang, C. Jacobs, and M. Cohen. Rapid modeling of animated faces from video, Journal of Visualization and Compute Animation, 12(4):227-240, 2001.

Z. Zhang and C. Loop. Estimating the Fundamental Matrix by Transforming Image Points in Projective Space. Computer Vision and Image Understanding, 82(2):174-180, 2001. CVIU link. PDF file.

Z. Zhang. A flexible new technique for camera calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(11):1330-1334, 2000. Also available as Technical Report MSR-TR-98-71.

Z. Zhang. Feature-based facial expression recognition: Sensitivity analysis and experiments with a multilayer perceptron. International Journal of Pattern Recognition and Artificial Intelligence, 13(6):893-911, 1999.

Z. Zhang, and G. Xu. A unified theory of uncalibrated stereo for both perspective and affine cameras. Journal of Mathematical Imaging and Vision, 9:213-229, 1998.

Z. Zhang. On the optimization criteria used in two-view motion analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(7):717-729, 1998. PDF file

Refereed Conferences and Workshops

M. Liao, M. Sun, R. Yang, and Z. Zhang, ``Robust and Accurate Visual Echo Cancelation in a Full-duplex Projector-camera System'', to appear in IEEE International Workshop on Projector-Camera Systems (ProCams), New York, NY, USA, June 17, 2006.

C. Zhang, J. Wang, S. Han, M. Yi, and Z. Zhang, ``Automatic Real-Time Barcode Localization in Complex Scenes'', to appear in IEEE International Conference on Image Processing (ICIP), Atlanta, GA, USA, October 8--11, 2006.

G. Hua, Z. Liu, Z. Zhang, and Y. Wu, ``Automatic Business Card Scanning with a Camera'', to appear in IEEE International Conference on Image Processing (ICIP), Atlanta, GA, USA, October 8--11, 2006.

A. Subramanya, Z. Zhang, Z. Liu, and A. Acero, ``Speech Modeling with Magnitude-Normalized Complex Spectra and its Application to Multisensory Speech Enhancement'', to appear in IEEE International Conference on Multimedia & Expo (ICME), July 9-12, 2006, Toronto, Canada.

X. Huang, J. Weng, and Z. Zhang, ``Adaptive User Activity Detection Using Multimodal Contexts'', in Proc. Third International Conference on Computational Intelligence, Robotics and Autonomous Systems, December 13--16, 2005, Singapore.

A. Subramanya, Z. Zhang, Z. Liu, J. Droppo, and A. Acero, ``A Graphical Model for Multi-Sensory Speech Processing in Air-and-Bone Conductive Microphones'', in Proc. Interspeech'2005 - Eurospeech - 9th European Conference on Speech Communication and Technology, September 4-8, 2005, Lisbon, Portugal.

Y. Chang, R. Cutler, Z. Liu, Z. Zhang, A. Acero, and M. Turk, ``Automatic Head-size Equalization in Panorama Images for Video Conferencing'', in Proc. IEEE International Conference on Multimedia and Expo (ICME2005), July 6-8, 2005, Amsterdam, The Netherlands.

A. Subramanya, L. Deng, Z. Liu, and Z. Zhang, ``Multi-Sensory Speech Processing: Incorporating Automatically Extracted Hidden Dynamic Information'', in Proc. IEEE International Conference on Multimedia and Expo (ICME2005), July 6-8, 2005, Amsterdam, The Netherlands.

G. Guo, C. Dyer, and Z. Zhang, ``Linear Combination Representation for Outlier Detection in Motion Tracking'', in Proc. International Conference on Computer Vision and Pattern Recognition (CVPR'05), June 20--25, 2005.

L. He and Z. Zhang, ``Real-Time Whiteboard Capture and Processing Using a Video Camera for Teleconferencing'', in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2005), Vol.2, pp.1113-1116, March 18-23, 2005, Philadelphia.

Z. Liu, A. Subramanya, Z. Zhang, J. Droppo, and A. Acero, ``Leakage Model and Teeth Clack Removal for Air- and Bone-Conductive Integrated Microphones'', in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2005), Vol.1, pp.1093-1096, March 18-23, 2005, Philadelphia.

Z. Zhang and L. He, ``Remote Collaboration on Physical Whiteboards'', in Proc. fifth Pacific-Rim Conference on Multimedia (PCM2004), Nov.30-Dec.3, 2004.

H. Zhou, Z. Zhang, and T.S. Huang, ``Visual Echo Cancellation in a Projector-Camera-Whiteboard System'', in Proc. International Conference on Image Processing (ICIP), Vol. 5, pp. 2885--2888, Oct.24--27, 2004, Singapore.

Z. Zhang, ``Response to Dialog: Object Detection and Object Variance in Autonomous Mental Development'', the Newsletter of the Autonomous Mental Development Technical Committee, IEEE Computational Intelligence Society, Vol. 1, No. 2, pp. 5-6, October, 2004.

J. Hershey, T. Kristjansson and Z. Zhang, ``Model-Based Fusion of Bone and Air Sensors for Speech Enhancement and Robust Speech Recognition'', in Proc. ISCA Workshop on Statistical and Perceptual Audio Processing (SAPA2004), Oct. 3, 2004, Jeju, Korea.

L. Deng, Z. Liu, Z. Zhang, and A. Acero, ``Information Fusion for Multi-Sensor Speech Recognition --- Extraction and Exploiting Hidden Dynamics of Speech Captured by a Bone-Conductive Microphone'', in Proc. IEEE International Workshop on Multimedia Signal Processing (MMSP'04), pp.19--22, Sep.29--Oct.1, 2004, Siena, Italy.

Z. Liu, Z. Zhang, A. Acero, J. Droppo, and X. Huang, ``Direct Filtering for Air-and Bone-Conductive Microphones'', in Proc. IEEE International Workshop on Multimedia Signal Processing (MMSP'04), pp.363-366, Sep.29-Oct.1, 2004, Siena, Italy.

Z. Zhang, and Z. Liu, M. Sinclair, A. Acero, L. Deng, J. Droppo, X. Huang, and Y. Zheng, ``Multi-Sensory Microphones For Robust Speech Detection, Enhancement And Recognition'', in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2004), Vol.3, pp.781--784, May 17-21, 2004, Montreal, Quebec, Canada.

H. Xiao, J. Weng, and Z. Zhang, ``Office Presence Detection Using Multimodal Context Information'', in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2004), Vol.3, pp.773-776, May 17-21, 2004, Montreal, Quebec, Canada.

Z. Zhang and L. He. Notetaking with a Camera: Whiteboard Scanning and Image Enhancement. In Proc. International Conference on Acoustics, Speech, and Signal Processing (ICASSP'04), May 17-21, 2004, Montreal, Quebec, Canada. Also available asTechnical Report MSR-TR-03-39.

Y. Zheng, Z. Liu, Z. Zhang, M. Sinclair, J. Droppo, L. Deng, A. Acero, X. Huang, ``Air- and Bone-Conductive Integrated Microphones for Robust Speech Detection and Enhancement'', in Proc. IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU2003), pp.249--254, November 30 - December 4, 2003, U.S. Virgin Islands.

H. Zhou and Z. Zhang, ``Color and geometric calibration for camera-projector-whiteboard systems,'' in IEEE Workshop on Camera Projector System (in conjunction with ICCV03), Nice, France, October 2003.

Z. Zhang and Y. Shan. Incremental Motion Estimation through Modified Bundle Adjustment. In Proc. International Conference on Image Processing (ICIP), Vol.II, pp.343--346, September 14-17, 2003, Barcelona, Spain.

Z. Zhang. Vision-based Interaction with Fingers and Papers. In Proc. International Symposium on the CREST Digital Archiving Project, pp. 83--106, May 23--24, 2003, Tokyo, Japan. Available in PDF here.

L. He, Z. Liu, and Z. Zhang. Why Take Notes? Use the Whiteboard System. In Proc. International Conference on Acoustics, Speech, and Signal Processing (ICASSP'03), Vol. V, pp.776--779, Hong Kong, April 2003. Also available as Technical Report MSR-TR-02-89.

R. Cutler, Y. Rui, A. Gupta, JJ Cadiz, I. Tashev, L. He, A. Colburn, Z. Zhang, Z. Liu, and S. Silverberg. Distributed Meetings: A Meeting Capture and Broadcasting System. In Proc. 10th ACM International Conference on Multimedia, pages 503--512, Juan-les-Pins, France, Dec. 2002.

Z. Zhang. Camera Calibration with One-Dimensional Objects. In Proc. 7th European Conference on Computer Vision (ECCV2002), Volume IV, pages 161-174, Copenhagen, Denmark, May 28-31, 2002. Also available as Technical Report MSR-TR-01-120.

R. Yang and Z. Zhang. Eye Gaze Correction with Stereovision for Video Tele-Conferencing. In Proc. 7th European Conference on Computer Vision (ECCV2002), Volume II, pages 479-494, Copenhagen, Denmark, May 28-31, 2002. Also available as Technical Report MSR-TR-01-119.

R. Yang and Z. Zhang. Model-based Head Pose Tracking With Stereovision. In Proc. Fifth IEEE International Conference on Automatic Face and Gesture Recognition (FG2002), pages 255-260, Washington, DC, May 20-21, 2002. Also available as Technical Report MSR-TR-01-102.

R. Kurazume, K. Nishino, Z. Zhang, and K. Ikeuchi. Simultaneous 2D images and 3D geometric model registration for texture mapping utilizing reflectance attribute. In Proc. Asian Conference on Computer Vision (ACCV’02), pages 99-106, Melbourne, Australia, January 2002.

C. Wu, C. Liu, H.-Y. Shum, Y.-Q. Xu, and Z. Zhang. Automatic Eyeglasses Removal from Face Images. In Proc. Asian Conference on Computer Vision (ACCV’02), pages 193-198, Melbourne, Australia, January 2002.

Z. Zhang, Y. Wu, and Z. Liu. Side Statistics and Maximum Discriminant Analysis for Real-Time Tracking. In Proc. Asian Conference on Computer Vision (ACCV’02), pages 308-313, Melbourne, Australia, January 2002.

Y. Wu, Z. Zhang, T.S. Huang, and J.Y. Lin. Multibody Grouping via Orthogonal Subspace Decomposition. In Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR'01), Kauai, Hawaii, Vol.II, pages 252--257, December 2001.

Y. Shan, Z. Liu, and Z. Zhang. Image-Based Surface Detail Transfer. In Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR'01), Kauai, Hawaii, Vol.II, pages 794--799, December 2001.

L. Lu, Z. Zhang, H.-Y. Shum, Z. Liu, and H. Chen. Model- and Exemplar-based Robust Head Pose Tracking Under Occlusion and Varying Expression. In Proc. IEEE Workshop on Models versus Exemplars in Computer Vision, (CVPR'01), Kauai, Hawaii, December 2001. PDF file.

Z. Zhang, Y. Wu, Y. Shan, and S. Shafer. Visual Panel: Virtual mouse keyboard and 3d controller with an ordinary piece of paper. In Workshop on Perceptive User Interfaces, ACM Digital Library, November 2001. ISBN 1-58113-448-7.

Z. Liu, Y. Shan and Z. Zhang. Expressive Expression Mapping with Ratio Images. In SIGGRAPH, pages 271-276, Los Angeles, August 12-17, 2001.  PDF file. The color plate has a few cool examples.

Y. Shan, Z. Liu and Z. Zhang. Model-Based Bundle Adjustment with Application to Face Modeling.  In Proceedings of the 8th International Conference on Computer Vision (ICCV01), Vol. II, pages 644-651, July 2001, Vancouver, Canada. PDF file.

K. Nishino, Z. Zhang, and K. Ikeuchi. Determining Reflectance Parameters and Illumination Distribution from a Sparse Set of Images for View-dependent Image Synthesis. In Proceedings of the 8th International Conference on Computer Vision (ICCV 2001), Vol. I, pages 599–606, Vancouver, Canada, July 2001.

Z. Liu and Z. Zhang. Robust Head Motion Computation by Taking Advantage of Physical Properties. In IEEE Workshop on Human Motion (HUMO 2000), Austin, USA, December 2000. PDF file

Y. Shan and Z. Zhang. Curve Matching with Probabilistic Relaxation. IAPR Workshop on Machine Vision Applications (MVA 2000), pages 248-253, Tokyo, Japan, November 2000.

Z. Zhang and Y. Shan. Visual Screen: Transforming an Ordinary Screen into a Touch Screen. IAPR Workshop on Machine Vision Applications (MVA 2000), pages 215-218, Tokyo, Japan, November 2000.

Z. Liu, Z. Zhang, C. Jacobs and M. Cohen. Rapid Modeling of Animated Faces From Video. The Third International Conference on Visual Computing (Visual 2000), pages 58-67, September 2000, Mexico City. Also available as Technical Report MSR-TR-99-21.

Z. Zhang and Y. Shan. A Progressive Scheme for Stereo Matching. Springer LNCS 2018: 3D Structure from Images - SMILE 2000, M. Pollefeys et al. (eds.), pages 68-85, Springer-Verlag, 2001.

Y. Shan and Z. Zhang. Corner Guided Curve Matching and its Application to Scene Reconstruction. IEEE Conf. Computer Vision and Pattern Recognition (CVPR'00), South Carolina, Vol.I, pages 796-803, June 2000.

Z. Zhang. Flexible Camera Calibration By Viewing a Plane From Unknown Orientations. International Conference on Computer Vision (ICCV'99), Corfu, Greece, pages 666-673, September 1999.

Z. Zhang, P. Anandan, and H.-Y. Shum. What can be determined from a full and a weak perspective image? International Conference on Computer Vision (ICCV'99), Corfu, Greece, pages 680-687, September 1999.

C. Loop and Z. Zhang. Computing Rectifying Homographies for Stereo Vision. IEEE Conf. Computer Vision and Pattern Recognition (CVPR'99), Vol.I, pages 125-131, Colorado, June 1999.

H.-Y. Shum, Q. Ke, and Z. Zhang. Efficient Bundle Adjustment with Virtual Key Frames: A Hierarchical Approach to Multi-frame Structure from Motion. IEEE Conf. Computer Vision and Pattern Recognition (CVPR'99), Vol.II, pages 538-543, Colorado, June 1999.

Z. Zhang. Feature-based facial expression recognition: sensitivity analysis. Proc. Post-ECCV Workshop on Advances in Facial Image Analysis and Recognition Technology, Freiburg, June 1998.

K. Isono, Z. Zhang, and S. Akamatsu. Synthesis of facial expressions from uncalibrated real images. Proc. IASTD Conference on Computer Graphics and Imaging (CGIM 98), Nova Scotia, Canada, June 1-3, 1998.

Z. Zhang, M. Lyons, M. Schuster, and S. Akamatsu. Comparison between geometry-based and Gabor-wavelets-based facial expression recognition using multi-layer perceptron. Proc. Third IEEE International Conference on Automatic Face and Gesture Recognition (FG'98), pages 454-459, Nara, Japan, April 14-16, 1998.

I. Shimizu, Z. Zhang, S. Akamatsu, and K. Deguichi. Head pose determination from one image using a generic model. Proc. Third IEEE International Conference on Automatic Face and Gesture Recognition (FG'98), pages 100-105, Nara, Japan, April 14-16, 1998.

Technical Reports

Z. Zhang and L. He. Whiteboard Scanning and Image Enhancement. Technical Report MSR-TR-03-39, Microsoft Research, 2003.

L. He, Z. Liu, and Z. Zhang. Why Take Notes? Use the Whiteboard System. Technical Report MSR-TR-02-89, Microsoft Research, 2002.

Z. Zhang. Camera Calibration with One-Dimensional Objects. Technical Report MSR-TR-01-120, Microsoft Research, December 2001.

R. Yang and Z. Zhang. Eye Gaze Correction with Stereovision for Video Tele-Conferencing. Technical Report MSR-TR-01-119, Microsoft Research, December 2001.

R. Yang and Z. Zhang. Model-based Head Pose Tracking With Stereovision. Technical Report MSR-TR-01-102, Microsoft Research, October 2001.

Z. Zhang, Z. Liu, D. Adler, M.F. Cohen, E. Hanson, and Y. Shan. Robust and Rapid Generation of Animated Faces From Video Images: A Model-Based Modeling Approach. Technical Report MSR-TR-01-101, Microsoft Research, October 2001.

Z. Zhang and Y. Shan. Incremental Motion Estimation through Local Bundle Adjustment. Technical Report MSR-TR-01-54, Microsoft Research, May 2001.

Z. Liu, Z. Zhang, C. Jacobs and M. Cohen. Rapid Modeling of Animated Faces From Video. Technical Report MSR-TR-99-21, Microsoft Research, April 1999. 

C. Loop and Z. Zhang. Computing Rectifying Homographies for Stereo Vision. Technical Report MSR-TR-99-21, Microsoft Research, April 1999.

Z. Zhang. A flexible new technique for camera calibration. Technical Report MSR-TR-98-71, Microsoft Research, December 1998.

Invited Workshops and Papers (not updated)

Z. Zhang. Vision-Based Modeling and Interaction. In the Fifth Asian Conference on Computer Vision (ACCV), Melbourne, Australia, January 2002.

Z. Zhang. Image-Based Modeling of Objects and Human Faces. In Proceedings of SPIE, Vol. 4309: Videometrics and Optical Methods for 3D Shape Measurement, pages 1-15, San Jose, USA, January 2001.

Z. Zhang. Modélisation d'objets: Des images aux applications. In la Conférence francophone sur la reconnaisance de formes et l'intelligence artificielle (RFIA), Paris, February 2000.

Z. Zhang, Y. Shan and C. Loop. Object Modeling from a Casual Collection of Images. In the Fourth Asian Conference on Computer Vision (ACCV), pages 905-910, Taipei, Taiwan, January 2000.

Z. Zhang. Computer Vision Research at Microsoft. In International Conference on Robotics, Automation, and Computer Vision, Singapore, December 1998.