Simon Baker

Simon Baker


I am a researcher in the Interactive Visual Media Group in MSR Redmond. Thanks to the kind support of my manager and the MSR lab managers, physically I am currently based at MSR Silicon Valley in Mountain View, CA. Before joining MSR in 2006, I was an Associate Research Professor in the Robotics Institute at Carnegie Mellon University. I obtained a Ph.D. in the Department of Computer Science at Columbia University in 1998, an M.Sc. in Computer Science from the University of Edinburgh in 1992 and a B.A. in Mathematics from Trinity College, Cambridge in 1991.

Research Interests

My research interests lie in the field of computer vision. I work extensively with a variety of Microsoft product groups including groups in Windows/Windows Live, Windows Phone, Bing/OSD, Xbox/IEB, and Skype.


A list of my publications is available here or here.

Software and Products

I have contributed to a number of products:

  • New Kinect
    • Depth enhancement algorithms
  • Windows Live / Windows 8
    • Rolling shutter correction
  • Windows Phone Mango 
    • Face taggng
  • Xbox Kinect / Avatar Kinect 
    • Face tracking algorithms
  • Expression Encoder
    • Pixel adaptive de-interlacing
  • Xbox Live Marketplace
    • Video enhancement
  • The movies "Avatar," "Rise of the Planet of the Apes", and "The Adventures of Tintin" (technology developed at CMU prior to joining MSR licensed to Weta Digital)
    • Facial performance capture


Contact Info