Zhengyou Zhang
Microsoft Corp., One Microsoft Way, Redmond WA 98052-6399, USA
zhang@microsoft.com
Principal Researcher at Microsoft Research (MSR), the research center of
Microsoft Corp. My research is in computer vision, speech signal processing, multi-sensory fusion, multimedia computing,
real-time collaboration and human-machine interaction.
I am affiliated with the Communication and Collaboration Systems Group,
the Speech Technology Group, and the
virtual Vision Technology Group.
I manage the Multimodal Collaboration Research Team.
|
|
Please visit my home page at INRIA for
information prior to my arrival (March 30, 1998) at Microsoft Research.
Education
-
B.S. degree in electronic engineering from the
University of Zhejiang, China,
in 1985.
-
M.S. degree (DEA) in computer science from the
University of Nancy, France, in 1987. Advisor: Jean-Paul Haton
-
Ph.D. degree in computer science from the University
of Paris XI, Orsay, France, in 1990.
Advisor:
Olivier Faugeras
-
D.Sc. degree (Habilitation à diriger des recherches) from the
University of Paris XI, Orsay, France, in 1994.

Short Bio
Zhengyou Zhang is a Fellow
of the Institute of Electrical and Electronic Engineers (IEEE).
He is the Founding Editor-in-Chief of the newly established
IEEE Transactions on
Autonomous Mental Development (IEEE T-AMD), and is on the Editorial Board of
the International Journal of Computer Vision (IJCV),
the IEEE Transactions on Multimedia (IEEE T-MM),
the International Journal of Pattern Recognition and Artificial Intelligence (IJPRAI),
and the Machine Vision and Applications.
He was on the Editorial Board of the IEEE Transactions on Pattern Analysis and Machine Intelligence (IEEE T-PAMI) from 1999 to 2004.
He is listed in Who's Who in the World, Who's Who in America
and Who's Who in Science and Engineering.
Before joining Microsoft, Zhengyou worked at INRIA
(French National Institute for Research in Computer Science and Control) for 11 years, and was a Senior Research Scientist since 1991, where
he worked in the Computer
Vision and Robotics group. In 1996-1997, he spent
one-year sabbatical as an Invited Researcher at the
Advanced Telecommunications Research Institute International (ATR), Kyoto, Japan.
He holds more than 50 US patents and has about 40 patents pending. He also holds a few Japanese patents for his inventions during his sabbatical at
ATR.
He has published over 200 papers in refereed international journals and conferences, and is the author of the following books
He is the Program Co-Chair of the 8th International Conference on Development
and Learning (ICDL09), June 5-7, 2009, Shanghai, China.
He was a Technical Co-Chair of the International Workshop on Multimedia Signal Processing (MMSP06), October 3-6, 2006, Victoria, BC, Canada.
He was the Program Co-Chair of the Asian Conference on Computer Vision
(ACCV2004), Jan. 27-30, 2004, Jeju Island, Korea;
a Demo Chair and an Area Chair of the
International Conference on Computer Vision (ICCV2003), Oct. 14-17, 2003, Nice, France; the Demo Chair of the
International Conference on Computer Vision (ICCV2005), Oct. 15-21, 2005, Beijing, China. He co-organized the International Workshop on
Multimedia Technologies in E-Learning and Collaboration, held in Nice, France, on October 17, 2003.
He served on the Program Committees of ICCV, CVPR, ECCV, ACCV and many other international conferences and workshops.
Zhengyou Zhang is a member of the IEEE Computer Society Fellows Committee
from 2005 to 2007, a member of IEEE Technical Committee on Multimedia Signal Processing and the Chair of IEEE Technical Committee on Autonomous Mental Development. He is a member of ACM.
Interview by the
Computational Intelligence Magazine is available
here
(or go to
IEEE Xplore).
Full version of his résumé is available by clicking here.
Collaborators, Post-Doctoral Researchers and Students
Zicheng Liu
(Researcher, MSR)
Mike Sinclair
(Principal Researcher, MSR)
Li-wei He
(Research Engineer, MSR)
Cha Zhang
(Researcher, MSR)
Rajesh Hegde
(Research Engineer, MSR)
Chunhui Zhang (Researcher, MSR Asia)
Ying Shan
(Post-Doc, now Scientist at Microsoft MSN AdLab)
Gang Hua
(Scientist at Microsoft LiveLabs)
John Hershey (Post-Doc, now at IBM Research)
Interns: Sasa Junuzovic (2008), Matt Luciw (2008), Aswin
Sankaranarayanan (2008), Xiaogang Wang (2008), Qing Zhang (2008), Raffay
Hamid (2007), Sasa Junuzovic (2007), Miao Liao (2007), Mingxuan Sun
(2007), Qi Zhao (2007), Amar Subramanya (2006), Sasa Junuzovic (2006), Ming Liu (2005), Gang Hua (2005), Amar Subramanya (2004), Ya Chang (2004), Yanli Zheng
(2003), Hanning Zhou (2003), Guodong Guo (2002), Ruigang Yang (2001), Ko
Nishino (1999, 2000), Ying Wu (2000), Qifa ke (1998)
Supervision of researchers when I was at INRIA:
Nassir Navab (Ph.D., 1993), Michel Buffa (Ph.D., 1993), Gabriella Csurka
(Ph.D., 1996), Bernard Hotz (Research Engineer, 1991-1994), Serge
Saracco (Master, 1993), Jean-Francois Ponthieux (Master, 1993),
Veit Schenk (Master, 1996), Laurence Lucido (Ph.D., 1997), Sylvain
Bougnoux (Ph.D., 1998).
IEEE Transactions on Autonomous Mental Development (IEEE TAMD)
-
Submission information available here.
-
Table of Contents with Abstracts and Links to PDF files:
Projects
Software Microsoft Easy Camera Calibration Tool
Recent publications: Click here
Some downloadable publications:
- Z. Zhang, and L. He, "Whiteboard Scanning and Image Enhancement", Digital Signal Processing, Vol.17, No.2,
pages 414-432, 2007.
available from Elsevier or at
http://research.microsoft.com/~zhang/Papers/ZhangHeDSP07.pdf
-
Z. Zhang,
"Feature-Based Facial Expression Recognition: Sensitivity Analysis
and Experiments With a Multi-Layer Perceptron",
International Journal of Pattern Recognition and Artificial Intelligence,
Vol.13, No.6, pages 893-911, 1999.
available at
http://research.microsoft.com/~zhang/Papers/IJPRAI.pdf
or
ftp://ftp.inria.fr/INRIA/publication/dienst/RR-3354.pdf
-
Z. Zhang, R. Deriche, O. Faugeras, Q.-T. Luong,
"A Robust Technique for Matching Two Uncalibrated Images Through
the Recovery of the Unknown Epipolar Geometry", Artificial
Intelligence Journal, Vol.78, pages 87-119, October 1995.
available at
http://research.microsoft.com/~zhang/Papers/ZhangAIJ95.pdf
-
Z. Zhang, O. Faugeras,
"Estimation of Displacements from Two 3-D Frames Obtained From Stereo",
IEEE Transactions on Pattern Analysis and Machine Intelligence,
Vol.14, No.12, pages 1141-1156, 1999.
available at
http://research.microsoft.com/~zhang/Papers/ZhangPAMI-92-12.pdf
-
Z Zhang, O. Faugeras, R. Deriche,
"An Effective Technique for Calibrating a Binocular Stereo Through Projective
Reconstruction Using Both a Calibration Object and the Environment ",
Videre: Journal of Computer Vision Research, MIT Press,
Vol.1, No.1, pages 58-68, 1997.
available at
http://mitpress.mit.edu/e-journals/VIDE/001/articles/v1n1003.pdf
-
Z Zhang,
"Motion and Structure From Two Perspective Views: From Essential Parameters to Euclidean Motion Via Fundamental Matrix",
Journal of the Optical Society of America A,
Vol.14, no.11, pages 2938-2950, 1997.
available at
http://research.microsoft.com/~zhang/Papers/ZhangJOSA-97.pdf
-
Z. Zhang,
"Image-based geometrically-correct photorealistic scene/object modeling (IBPhM): A review",
Proc. 3rd Asian Conf. on Computer Vision (ACCV 1998),
pages 340-349, Hong Kong, January 8-11, 1998.
available at
http://research.microsoft.com/~zhang/Papers/ACCV98.pdf
-
K Nishino, Z Zhang, K Ikeuchi,
"Determining Reflectance Parameters and Illumination Distribution
from a Sparse Set of Images for View-dependent Image Synthesis ",
Proc. International Conference on Computer Vision (ICCV 2001),
Vol. I, pages 599-606, Vancouver, Canada, July 2001.
available at
http://research.microsoft.com/~zhang/Papers/ICCV01-Reflectance.PDF
- Z. Zhang, "On the optimization criteria used in two-view motion analysis", IEEE Transactions on Pattern Analysis and Machine Intelligence,
Vol.20, No.7, pages 717-729, 1998.
available here.
- Z. Zhang, "A flexible new technique for camera calibration", IEEE Transactions on Pattern Analysis and Machine Intelligence,
Vol.22, No.11, pages 1330-1334, 2000.
available as Technical Report MSR-TR-98-71
- Z. Zhang and C. Loop, "Estimating the Fundamental Matrix by Transforming Image Points in Projective Space", Computer Vision and Image Understanding,
Vol.82, No.2, pages 174-180, 2001.
available from
CVIU link. or from here.
- Z. Zhang, Y. Wu, and Z. Liu, "Side
Statistics and Maximum Discriminant Analysis for Real-Time Tracking",
Proc. Asian Conference on Computer Vision (ACCV 2002), pages
308-313, Melbourne, Australia, January 2002.
available
here

Tutorial
Parameter Estimation Techniques: A Tutorial with Application to Conic Fitting.
PDF version, HTML version, and PostScript version
Published in Image and Vision Computing Journal, Vol.15, No.1, pages 59-76, 1997.
What's new?
-
Editorial for the inaugural issue of the IEEE Transactions on Autonomous Mental
Development
- Microsoft Research Feature Story:
Making Virtual Meeting Feel Real
- Interview by the
Computational Intelligence Magazine is available
here
(or go to
IEEE Xplore).
- Recent publications:
- J. Weng, B. Scassellati, and Z. Zhang, editors, Special Issue on Autonomous Mental Development: Mind, Body and Beyond, International Journal of Humanoid Robotics (IJHR), Vol. 4, No. 2, June 2007.
- M. Liao, R. Yang, and Z. Zhang, "Robust and Accurate Visual Echo Cancelation in a Full-duplex Projector-camera System", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 30, No. 10, pages 1831-1840, 2008.
- A. Subramanya, Z. Zhang, Z. Liu, and A. Acero, "Multisensory Processing for Speech Enhancement and Magnitude-Normalized Spectra for Speech Modeling", Speech Communication, Vol. 50, pp 228-243, 2008.
- C. Zhang, D. Florencio and Z. Zhang, "Maximum Likelihood Sound Source Localization and Beamforming for Directional Microphone Arrays in Distributed Meetings", IEEE Transactions on Multimedia, Vol. 10, No. 3, pages 538-548, Apr. 2008.
- Z. Liu, M. Cohen, D. Bhatnagar, R. Cutler, and Z. Zhang, "Head-size Equalization for Improved Visual Perception in Video Conferencing", IEEE Transactions on Multimedia, Vol.9, No.7, pages 1520-1527, 2007.
- Report "Whiteboard Scanning and Image Enhancement"
available in PDF (3.5MB).
- Paper "Vision-based Interaction with Fingers and Papers"
available in PDF (945KB).
- Report "Why Take Notes? Use the Whiteboard Capture System"
available in PDF (2.2MB).
-
Report "Camera Calibration with One-Dimensional Objects"
available in PDF (2.4MB).
-
Report "Eye Gaze Correction with Stereovision for Video Tele-Conferencing"
available in PDF (4.6MB).
-
Report "Model-based Head Pose Tracking With Stereovision"
available in PDF (3.6MB).
-
Report "Robust and Rapid Generation of Animated Faces From Video Images: A
Model-Based Modeling Approach" available
in PDF (13MB)
-
Report "Visual Panel: From an ordinary paper to a wireless and mobile input
device" available in PDF
(0.95MB)
Photo Galleries