Although computer vision continues to be a formidable computing challenge, vision techniques are maturing rapidly and finding their way into many applications—including natural user interfaces based on a visual understanding of scenes, actions, and 3-D data. Kristin Tolle chairs this keynote at Faculty Summit 2011, in which Rick Szeliski surveys computer vision technologies that were developed at Microsoft Research over the last decade, as well as ongoing challenges in the field.